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ABSTRACT . \ 

A description is presented of the teacher training 
component of the Assessment of Language Proficiency of Bilingual 
Persons (ALPBP) project that was implemented over a per|pd of 2 years 
in Tucson (Arizona) and Berkeley (California). The goal of the Tucson 
section was to provide a forum wherein teachers and administrators 
could explore the application of ethnographic/sociolinguistic 
theories and methodologies to language proficiency assessment 
practices. The Berkeley program consisted of a summer course whose 
goals were to introduce teachers to theoretical issues involved in 
educating language minority students. This report is presented in 
three parts as follows: (1) "A Course on Bilingual Language 
Proficiency Assessment/" by S. Philips; (2) 

"Ethnographic/sociolinguistic Issues ^nd the Assessment of Bilingual 
Students* Language Proficiency," by C. Rivera and C. Simich; and (3) 
"Berkeley Summer Program for Teachers. A Course on Language 
Proficiency and Minority Students," by J. Cummins and L. W. Fillmore. 
(AMH) 
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The ALPBP Teacher Training Component 

The teacher training component of the ALPBP project was Implemented ov«r 
a period of tvyb years in two different locations: Tucson, Arizona and Berkeley, 
Cal ifornia. ' 

In Tucson, Arizona, the teacher training component was Implemented In 

cooperation with Tucson Unified School District (TUSD) and the University of , • 

■ •■ ■ « . ■ ■ . . - 

Arizona. Tucson was selected because of the district's interest In providing 
teachers, resource personnel arid administrators with basic training in alter* 
native modes of assessing "language proficiency. 

TUSOadminstrators felt that the ALPBP teacher training program In 
ethnographic/soclonngulstic methodologies would complement their efforts In 
developing a nontradi tlonal language proficiency assessmerit instrument, the 
Language Proficiency Measure ( LPM) (TUSD, I98I).. . 

.The general goal of the training component of the ALPBP project was to 
provide a forum wherein teachers and administrators would explore the applica- 
tion of ethnographic/sociol inguistic theories and methodologies applied to 
language |irof I clency„ assessment pract Ices . In order to accompl Ish thi s goal ■, 
bilingual and monolingual educators were provided with a background- In 'linguis- 
tics, soclol ingulstics, ethnography of speaking ,. measurement, and research 
methodology. The expected outcome of the training was that it would enable 
Tucson educators to develop, more effective language proficiency assessment 
strategies appl icable-'to their particular student population. •'. 

The teacher training program at Berkeley, California, consisted of a 
summer course offered through the University of California. U was entitled. 



•'Speaking of English: Teach irtg the Language Minority Student." The goals 
of the course were to Introduce participating teachers to theoretical issues 
Involved in educating language minority students. 

The process of implementation, outcomes, and evaluation for each of 

the training programs are, in the ALPBP Teaching Training Report components;' 

A Course on Bilingual Language Proficiency Assessment' 
Susan Phi 1 fps 

Department of Anthropology 
University of Arizona 

Ethnographic/Sociol Inguistic Issues and the Assessment 
of Bi 1 fngual Students ' Language Proficiency 

Charlene Rivera ^ 
ALPBP Project Director 

/ . earmen Simlch 

ALPBP Project Research Associate 
InterAmerica Research Associates, Inc. 

Language Prof I clency and Minor I ty Students 
Jim Cummins 

The Ontario Institute for Studies in Education 
Lily Wong Fillmore 

University of California at Berkeley, ^ 
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■A'^OURSE ON BILINOUAL LANGUAGE PROFICIENCY ASSESSMENT 

OVBRYIEW 

Fart I: Approaches to Bilingual Language Proficiency ^ 
The purpo9e of this report is to ^escribe, explain^ and evaXixate a 
coiarse that was taught at the Universitjy of Arizona hy Dr« Susan Philips 
on Bilingual Language Proficiency Assessment ^ in the Spring, of 1980. 
The course was funded by.M.I.E. through a grant to tnt^iiamflti^ica intended 
to Stimulate both teaching and research on th^^ topic of* language proficiency 
assessment. ^- (% . , ' 

The general purpose of the course vas to provide., bilingial teachers 
with information about approaches to language and language use that would 
be helpful to the teachers in their efforts to assess the "proficiency" 
of their students in. Sjpanish and English. From the beginning, of the 
instructor's involvem^t in planning the course, the coxurs« was intedned 
tb be "ethnographic" Jsi l?asic orientation and emphasis., with that ethno- 

graphic orientation viewed as innovative in the area of language proficiency 

\ ■ . ■ . - ■ , • • , - ; - 

assessment. The instructor began the course with the view that present 
approaches to bilingual language proficiency assessment- are inadequate 
and inappropriate in several key respects that caln be remedied in part 
through the Joining of bpth theoretical/substantive and methodological 
aspects of ethnographic approaches to language use with the more institu- 
tionalized approaches to a language proficiency assessment associated with 
educational psychology, and to a lesser degree, cognitive psychology • 

Because this ethnographic perspective is so crucial to the organization 
of the course, ah effort will be made to explain why and how that perspective 

. . ■ * - . ^ 



is thought to have potential for improving language proficiency assessment 
processes. 

In the United States, bilingual education programs e:qist primarily 
because of ovar civil rights commitment to equal education. Children whose 
first language i§ other than English (and these overwhelmingly Spanish in 
language hackgroxind) generally have had lower scores on school achievement 
tests than monolingual English speakers, and it has been argued that . 
bilingual education would provide bilingual children with equal access 
to the education system, and eradicate the achievement score disparities 
between bilingual and monolingual children- 

la fact 9 such eradication of achievement score disparities has not 
occurred. One response to the absence of change in achievement scores , . 
in spite of bilingual education, has been to criticize the tests that 
measure achievement, and to argue that the tests are culturally biased, 
and do not capture ^rtiat the children know, or that the tqsts don't even 
measure very worthwhile skills and perspectives being transmitted through 

^r. ... . , ' . " 

bilingual programs. Within this framework, language proficiency tejsts 
have come in for their own share of criticism, and it has been argued 
that if the tests that measured the children's relative competence (in 
e..g. Spanish fiuad English) were better, then placement of children in ^ 
particular educational programs would be more effective, and achievement : 
scores would ia^rove. While this is an over^implifidation of a very complex 
set of issues, it sets the general framework for what. I will call an 
ethnpgraphic critique-. 

From a substantive point of view, an ethnographic orientation entails 
the notipn that chilciren's- school language skills should be viewed 'within 
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a broader ffameworlc of culturally acquired comnnaniGative conjpetence. 
While cultural differences in children's pre-school and' outside of school 
language socialization experiences have been recognized for some ethxiic 
minority populations in this country, notably Blacks and IJgrth American .' • 
Indians, such cultural differences^ have been given less attention in the 
discussion of the educational problems of our bilingual populations. Poi*" 
those groups, the linguistic difference has been so salient that it has .. 
received mo&t of the attention. In addition, there is a tendency among 
at least Hispanic groups to associate culture with food, dance, and other 



I very visible markers of ethnic or national identity, rather than the less 

•di^playable features of everyday cultture which comprise children's sociali- 
L zation* 

An ethnographic, and fundamentally anthropological, view of language 
proficiency is that the concept should embrace the child's full range of 

[_ social uses of language and nonverbal* signals rather than encompassing 

• , - . . . ... 

f only the narrow uses associated with the transmission of the literacy 

Skills of reading and writing. We could then ask what the relationship 

I is between the child' s coimnunicative skills in different domains , and 

consider how knowledge of the child's communicative skills in non-academic 

L activities might shed light on and help interpret or explain his or her 

patterns of language use in academic activities. 

r - ■ . • " ■ " ■ ■ ■' • : ^ ' ' - 

An ethnographic view of language socialization invokes '^culture" and 

(* ■•.. ■ " ^ ■ ■ • " 

cultural differences, in language 'socialization to explain the poor achieve- 

■\ * - . • 

ment scores of children from ethnic minority backgrounds* School curricula 

L assume and build on a single model of language socialization* Sometimes 

there is a poor fit between the school de^lopraental model, and the child's 

pre-school language socialization experiences* ^1,. 9 



jhe develoj-ental .odel Is ^sed on white middle =la,s3 childrea's 
pre-chool language sociaU.atlon e:cperiea=es. the ethnic minority ^ . 
..ild. s lan»^ socialization is =^t»ally different. Minority children ■ 

to school taovina differert ^nds of things. When they encomter : 
school tests, it is as if they are as.ed to perform ^A^les" vhen they, 
inow "oranges," and no one ever tests for "Oranges." 

Stated ,uite slBply. if - are to »eet children where they are as they 
=c«e into schools. .«d if we are to ^uild on their strengths, then we 
n.«l a description of the nature of the co-micative competence of 
children from ethnic minority haeigronnds. so that this can he d^ne. ' 

also need to .now h^ cnltnral differences affect chil^en's classroom 
hehavior. so that when a child is having difficulties in school, we csn 
tell that it is heca.se the teacher and the curricnlnm presuppose cultural 
^owledge in the child that she or he d.esn-t have. Perhaps we ^ even 
ietirmine what sort of taowledge is Wved. In other words , an- ethno- 
^hic perspective entails the advocation .f the concept of .culture and 
an «=planatory tool in bilingual language proficiency assessment, 

^ a methodoloaical point of view, an ethnographic perspective holds 
that experimental methodologies can never enahle us to grasp the nature of 
.i^dren-s. co-unicative competence, hecause such ^thods hy their very 
nature alter that competence. Instead, ohservation! participant observa- 
tion, a^d interviewing are reco-ended a, the research; tools to he used in 
determining the nature of children's com^nicative competence, and the plac 
of educational testing approaches to Unguage proficiency assessment is 
vlthin that hroader.perspective Of communicative competence. It ha, also 
heen argued that teachers can benefit from being trained to carry out ' 



ethnographic research on their students ' coiisminicatlLve competence because 
it will broaden their perspective- on their students' language skills, 
enable them* identify students' communicative strengths > and to build 
on those stren^rths and use them in academic cog^tive development . 

This, thfjn, was the ethnographic perspective with which the course 
was begtm. 

The courae itselC can be viewed a» an interaction between this 
perspective, 'And the concern of the instructor to meet, the nee^s^ol^the 
students in the course* Accordingly, it is appropriate to provide some 
information about those students and their concerns. 

The students for the coufse were recruited through the Title VII 

program in the Tucson Unified School District, generally known as District 

ft . • 

One, and the Sunnyside District, also in. Tucson. All but'bne of the 

students wau involved in District One bilingual education programs in, 

one way or another. Of the fifteen people who came to class the first 

day with an interest in enrolling in it, 6 were grade school classroom • 

teachers ixi ^'^full" bilingual programs. Pour of these ^wei*^ first grade 

teachers, oae a second grad^ teacher, and one a fourth grade teacher. 

It was to this fiproup that the course was most directly addressed-' There 

were also two teachers in pull-out programs for Spanish Reading who^wcrked 

with SponiMh dominant children in the first three grades. There was one 

high school teacher who worked with freshmen in a Title VII bilingual program 

whose stuilenta were Mexican American, but who were learning^Spanish at a 

beginning level, ^ Two people in bi strict One were in non-t caching positions. 

associated with bilingual programs .(a resource person, who spent most of 

her time tea ting children and evaluating tests, and a Title VII evaluator 



) 



who was also the liasdn persoa TJetween* District One, the. ooiir^^^ instructori ' 

• - ■ ' _ B 

and lateramerica) , three administrators were from grade schools with 

hilingual pwgrams. ITone of these last three ended up taking 1?he bourse • 

■ . ■ ■ . • ■ . a. 

Finally, there was one teacher whOi worked with LD studtents on their - 

* . ■ * . • ■ ■ ■ 

literary skills in a grade schqol pull-out program. All but tvo of the 
people were functionaJLly Trilingual in Spanish and English. -'Thi-S range 
re^!?«ents well the kinds of people who came 'in and out of the" course , and 

•=> . . ' ~ ' . • • • . 

the range of kinds of people who *finiaLLly finished the course. * 

Prom the first day of class, it was clear that\most at the teachers. - 
were iur^a fairly difficult position in.' their roles as assessors of bilingual 
language proficiency. THey began the school year iix^ programs in which' they 
had little 6r no "say'^ in detentiininjs ^ich children were -plaqed in bilingual 
programs, or which children were defined as Spanish dominant or Engliish 

do minant . Most of these teachers had to administer tests designed to - 

. - ' ' » ■ . 7 ■• ■ ■ 

measure language proficiency at some point during the school year, ^ but ^ 

they usually did not receive the tesA. scqrfes^ until after the' chi^dren ,^ 

had moved on. to another grade.' And most of the te2!^ers ,* at some point / 

during each year, made and acted upon decisions thjat cduld seriousjLy affect 

a child's academic progress--^ecisioxxs that were based on their own 

assessment of their students* language skills: Should a child be recommended' 

for learning disability testing? Should he he switched from the Englis^i 

dominant to the Spanish dominant renting'' group? And so on. 

^ r * ■ ■ * ■ * • 

Generally, the teachers believed tjiey were in a better position' iq* 

" ■ ' . * ' ■ 

assess their students' skills than others, since they see them using 

language far more than anyone else, and are proficient hilinguals themselves. 



unlike many aidministrators. Some of the teachers who came to this coiarse 
were critical of the formal instruments used to. measure proficiency, ondL 
sJosptical about their validity. Some of the teachers distrust those who 
teat students for learning disabilities on the grounds that none of the 
formal testing 'instruments were in Spanish.' 

At the same time, none of the teachers had had any formal training 
in hqv to evaluate and interpret formal tests, so they lacked confidence 
in their own critical oriehtationv And they vere clearly avare that their 
own language proficiency assessments lacked credibility with administratiW 
personnel who made the student placement decisions with- which the teachers 
had to live. Several teachers expressed concern over the fact that th^ 
are not consulted or that their opinions are given little attention in • 

placements decisions that atre supposecKito b^based on liaitguage proficiency 

. . ' ' 

assessments^ 

In general, then, the teachers came into the class ^ with ambivalent 
feelings about bilingual langjuage proficiency assessment • On the one hand, 
they felt their' knowledge of their students' language proficiency was 
crucial for the child's academic development. On the* other hand, they 
felt "inadequate in their knowledge and atixious over the decisions they 
vere making* 

Clearly, then, the primary -practical aim of the coiarse becam;e to pro- 
vide the teachers .with information that would facilitate their language » : 

proficiehcy assessment activities. 

■ ' ■ ■ ■ • ■ • . > . , ' . 

There were three parts to the course. Part 1 was an overview of 

approaches to bilingual langu^e proficiency assessment , with emphasis 

on sociolingxiistic and ethnographic approaches. Part II focus.ed on the 



nature of the ciiild's communicative competence In the classroom and the 
teacher's assessment of hilingual language proficiency in that context* 
Part III dealt with the child's comounlcative competence In the community, 
and with the effects of cxiltanral hackground on that competence* We will 
nov consider each section of the course in more detail, * 

Part I: Approaches to Bilingual Language Proficiency 
The primary purpose of this first five-week section was to introduce 
varidTxs approaches to or definitions of languiage proficiency that can he . 
\of use to teachers in their language proficiency assessment, and tg iitbe- 
grat^Kfeios^^^proaches into a single cohereiat view* Above all, it was 
thought to he imposrtant to^ develop the^ notion of communicative competence 
as the most integrated approach to language proficiency, and to demonstrate 
the advantages of such a view over the^mqre strictly linguistic notions of 
proficiency and the more "literacy achievement" definitions of proficiency 
that are ssiient. in educational testing today." 

Communicative Cbntpetenee 

There are three aspects of the concept of communicative competence 
^ that were highlighted in the course: First, attention was given to the * * 
point that cbtmtitmicative competence involves the influences of both human 
.biplogioal make-up and .culturally acquired knowleldge in the determination v 
of the structure df language* Lectures and reading materials developed 
awareness of the biological role of the brain in processing language, 
foctising on the lateraXizat ion of language ;. and areas in the "brain • 
asfsdciated vith particidar aspects- of lang^^^ structure (e.g. Brock's 
area.).' Awareness of the c;lltural diaension of language struetiire 



vas developed tiirough comparlisons of English and Spanish phonology; 
laorpholog^f syntax and semantic structure. Evidence of inter-cultural and 
inter^linguistic variation in language vas also presented through lecture 
material on the nature of dialectal, stylistic and contextual variation 
in language use/ In this way basic lingulsitic concepts were reviewed. 

Second, attention was given to the point that communicative competence 
is a combination of linguistic and social knowledge, and the concept (as 
developed by Dell ^/mes) refers to what a person must know to communicate 
in a socially appropriate fashion The point was made that intra 
. linguistic diversity ia dialect and style is matched by a functional 
differentiatioa in code use that could affect the nature of a child^s 
language proficiency in two languages. We discussed Wendy Hedlinger^s 
findings in a Tucsoa study of mothers; of bilingual children that reported 
their accoxm^s of which language they use for various functions/purposes 
with, their children~e.g. the finding that the mothers tend to '^scold** 
in Spanish, but to "praise" in English. 

To incr;sa^e teachers' awareness of the relation between linguistic 
form and ftaaction, transcripts of tape recordings of diverse situations 
in both Spanish and English were provided as class handouts throughout 
the first section of the course. Thus, the teachers were giv<^n traiiscripti 
in Spanish of a formal interview on television. Radio Fiesta commercials, 
a Spanish class at the University of Arizona, and a child's re-telling 
of a narrative told to him in Spanish. 

^ This- concern with the social pattesming of code use was then expanded 
to include non^linguistic aspects of cozmaunlcative competence, particularly 



•10- 

non-verbal signals • Specifically, the students in the class were 
encouraged to consides: the following aspects of coiomuaicative competence 
in face-to- face interaction: 1, The Attention Structure of face-to- 
face interaction, or the behavior of teacher and students that signals 
who is paying attention to whom; 2. The Turn Economies of various / 
interaction, or the teacher's and students' use of different formats 
tor dete rm i nin g who will speak when 1;o whom; 3. Discourse Structure , 
or the way in which different individuals build on the utterances of . 
others;, Linguistic Form , or the linguistic "properties of the utterances 
of different individuals in various social settings and from diverse social 
backgroTwd, and 5. Cultural Kjiovledge , or the differences in taaowledge 
that affect our ability to contribute to verbal interaction in a socially 
appropriate and meaningful manner. 

In the lecture material on these five aspect? of communicative compe- 
tence, emphasis was given to the point 'that people from culturally 
different backgrounds diffe*^ in all of these areas, and that all of 
these isLspects df communicative competence are part of normal human 
assessments of language proficiency. The teachers were asked to considei^ ^ 
the extent to which these various aspects of communicative entered into 
their own language proiTiciency assessments. 

The third aspect of cpimmmlcatlye competence that was given particular 

emphasis in the first section of the course was the developmental process 

through which communicative competence was acquired. In this section, 

^4 ■ • - ■ * . • ■ '• ■ ■ 

the first tvo feati]res;of coistsanlcatlve competence which had been given - 

attention wre again raised and developed IHarther^^ 



discussion of the ways in whibh the development of cozranunicative compe- 
tence involves toth biological dimensions (whi<^h are the main source of 

cross-linguistic and cross-culljural similarities in the developmental 

■fc • ' ■ 

'process) and social or culturaj^ dimensions (which are the main* source of 
■ . ". ■ ' ■ • • ■ .. ■ ' ' 

diversity ia the development of communicative competence). Both the 

developmental process and its cultuirally specific nature were demonstrated 

throTigh example^s of the culturally specific development of competence in 

the five aspects of competence just reviewed: attention structure, turn 

economies^ discourse structure, linguistic form and cultural knowledge, 

drawing heavily on the instructor's own research on the Warm Springs 

reservation. Thus, to illustrate, the discussion of attention structure 

suggested that while children's ability to pay attention to a single 

signalling source generally increases over time. Warm Springs Indian 

children demonstrate a greater' capacity to sit still (behavior that is 

taken as evidence of attention in the classroom) for longer periods at 

■* - ... , . ' . 

earlier ages than Anglo children, a trait that can be directly related 
to their home socialization for stillness and calmness. 

This notion of culturally specific developmental sequences was con- 
trasted with the educational assTomption implicit in curriculum materials 
and associated instructional booklets that there is only one relevant 
developmental sequMice in terns of which cliildren's language proviciency 
can be measured. 

* ■ ■ ' . ■ '■ ■ 

Some attention was also given to efforts to lay out developmental 

models of second language aciquisition. We discussed the notion that the 

age at, which a. second language is acquired will affect the acqtiisiliion 



process becatise of the already discussed developmental stages in the 
brain that affect language acqxxisit ion (e«g« research on Genie; the notion, 
that one can't pronounce like a native if one learns a second languag^e 
after the age of ll^). 

Attention was also given to the conflict between the currently salient 
view that the seq.uence of acquisition of linguistic foim is the same in 
acquirizig a language as a first or a second language, due to universal 
biologically-based constraints and the view that the acquisition of the 
foim of the second language . shows interference from 'the structure of the 
first language. The focus on second language acquisition of course also 
entailed consideration of functional differentiation of the two languages 
in the acqxiisition process, but not in any detailed inanner. 

Applications of the Conce'pt of Communicative ComTsetence in Bilingual Language 

- ■ . ■ '1 . - ■ • 

Proficiency Asses sment 

The first section of the coxnrse also covered two specific aspects of 
the application of the concept of ^communicative competence" in the practical 
activities of bilingual language proficiency Assessment in schools. 

Fl^rst,'it was suggested that educators are interested in variation in 
Students' language proficiency primariJly in relation to variation in 
academic achievement, and more specifically in relation to explaining poor 
academic achievement. 

When a child does poorly in school, there is a need to determine what ' 
sort 6f educational: program will improve the chlld^s performance. That 
need In turn has 'given rise to variotis EXPLANATORY FRAMEWORKS for explaining 
vhy a given child is doing poorly* The choice among explanatory frameworks 



will in tunx distermine the choice of special program chosen to Improve 

the performance of a given cfa^d. .Several ej^planatory frameworks were 

discussed to illustrate this notion to the teachers: 1. The normal curve t 

In all 'skill areas » some people do better than others, and if this v 

variation. Inherent iu an7 normal poptilation, is measured performance 

will he distributed along a noxitiai curve. In this class, this variation 

vas characterized as probalxLy biplpgically based, although in practice . 

poorly understood. No special programs are called for when poor performance 

is viewed within, this framework. 2. Learning Disabilities : When poor . 

performance is explained in terms of a learning disability, a special 

progxum designed to coi^ensate for that disability is thotight to be called 

for. 3. Linguistic differences ; If a child is thought to' be doing poorly 

due to the fact that he is bilingual, and more coiopetent in a language other 

than the one being used f or^ instruction , bilingual education is thought 

to be called for for that child* 

The teachersv in the class had already exppjessed their concern that 

the wrong explanatory framework is often used in^^iagnoslng" and "trea^ing^ 

bilingual children who are doing poorly in school, althotigh they did not \ 

><» ' . . . • . . ■ '■ * ■ 

express their conbeam in those terms. Particula2?ly, they were concerned 

that children who are bilingual are labeled as having learning disabilities, 

when they don't. This notion was expanded through a key point of the 

course, namely that there is a need for another explsuiatory framework, 

namely the notion of CULTURAL DIFFERHSrCES IH CGMMUNI(li\TIVE COMPETI^ 

The point here was 'that cultural differences in commtanicative competence 

and in the developmental sequences in the acquisition of . commxinicative 



competence can cause children to be unable to comprehend what they are 
being taught dn the classroom* Si;ch a causal framework: should be one. 
of the options considered In attempting to explain and do something 
about difficulties children are having in ^school. 

This notion also entailed a criticism of educisitlorial testing:, namely 
that formal measiires of bilingual language ^ proficiency, or testing instru- 
ments,, do ndt alloy for or recognize cultural and stluatlonal differences 
in language use, but rather capture only limited aspects of communicative 
competence within a single cultural framework. 

This point was pursued in the context of general discussion of the 
role of educational. testing in language proficiency assessment, which 
dealt with both the methodological and substantive aspects of testing « 
First the instructor lectured on the differences and relative advantages 
of the psychological experimental methodology of educational testing and 
the anthropological ethnographic methodology associated with the concept., 
of communicative ccnipetence: the experimental methodology controls data 
collection t^pugh presentation of the same stimxili in the same environ-^ 
ment to alX subjects by structuring the situation for the subjects* 
Ethnographic methodology involves coUectloz; of data through observation 
' of naturally occurring actlvi-^ies. The experimental methodology has the 
advantage that much comparable data ca& be Quickly gathered, and the dls^ 
advantage that it is difficult to determine what the relationship of the 
testing situation is. to naturally occurring xises of language. The 
etiinographic methodology has the advantage that naturally occurring uses 
of language and relative skills on those uses are assessed, but the * 



disadvantages of that large ^amount of directly compara^ble material on 
different Individuals cannot be obtained quickly* 

Through discussion of language proficiency assessment instruments 
that cure used In the Tucson schools, which, were available for examixiation, ' 
teachers were shown how they coiild readily determine what aspects of 
communicative competence were being m^sasured by different tests* Two * 
points were given particular attention: First, any given test usually 
focuses on some limited aspect of control of linguistic, form, and treats 
it as if that aspect (e*g. vocabulary, syntax) could stand for the whole 
of language. 'Which aspects are focused on can be readily identified. 
Second^, it is Impo^ant to deteraiine whether verbal skills or a combina- 
tioa of verbal and literacy skills is being tested. Teats that require 
the child to examine printed materials for any purpose merge literacy skills 
with verbal skills y and may conf oiand the two. 

The general practical ptxrpose of this discussion was to convey to 
the teachers that they must know what* the tests test and how they test, 
so that the/ c^tn supialement test results with tHeir own giaitherlng of 
information on skills that are not tested by the tests, yet are relevant 
to school achievement. This flpal point brought us to the second section 
of the course, wliich ' focused on teachers' language proficiency assessment 
aurbivities in the classroom. ' 
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Part lit Congminlcatlve Competence in the Classroom 
!Che general goal of the second part of the coxarse was to teach 
the teachers to carry out ethnographic observation in their classrooms, 
end to use that skill ia increasing their awareness of the nature of 
their students' comnunicative competence in the classroom, . 

The means used to .accomplish this goal was a research project in . 
which the teachers were to describe their own bilingual language proficiency 
assessment activities, or to do an ethnographic description of their own • 
evaluation activities and the interpretive procedures they use in assessing 



students' proficiency. There were no assigned readings for this section 



of the coxxrse,.and the in--class lecture and discussion activities were v 
organized entirely around the facilitation of this projects 

In the first phase of the project, the teachers were required to pro- 
vide an initial description of their language assessment procedures. 
iESach student in the class was asked to rank' a group of 10 of their students 
,,..-"in terms of their relative language proficiency in both Spanish and 
English. Thus^ there would be two separate rankings^ which could involve 
eitlier the same or different children. . They were asked to describe the 
aspects of the children's communicative competence that they attended to 
,in making their laziguage proficiency assessments, and the contexts within 
.the classroom which they relied upon in making those assessments. 'The 
inistructor made it- clear that those in the class who were not regular 

classroom teachers wotild be able to adapt the!^ assigxment to their, interests 

\ . • " •' • • ■. v • ■ 

and practical circiiiastances. . 

■ The second phase of the project was the collection of language use . 

^ .data in the .classroom. The teachers were asked to tape record the students 



they had ranked in the langiiage use activities in both Spanish and 
English that the teachers use as a haais for their language proficiency 
assessments • They were then to traascWbe 10 minutes of the Spanish 
. activity and 10 minutes of the English activity. — 

The third phase of the research project was the analysis of the 
data "base in terms of the extent to which the behavioral evidence of the . 

children's language use actoially correspondeti. with: the teacher's Initial 

t . . . . . . ■ ■ ' . ■ ■ ^. 

bilingual language proficiency assessment. Specif icalLy, the teachers ; 

were to deterniine whether the students who had heen ranlced as more pro- 

in the transcripts 

ficient in a given language actually displayed ^eater amounts /of ^rfwitever. 
qualities the teachers had indicated" they eyaiuated positively. Thus, 
for. example, if a teach<Hr initially indicated tiwLt she used size of 
vocabulary of words with three or more syllables as a criterion in 
'evaluating language proficiency, "then she was to determine whether the/ 
students she had ranlced as more proficient acttially exhibited more three 
or more syllable words in their speech than those she viet^ed as less pfoficient* 

Where the'" students* behavior conflicted with the teachers initial 
evaluations, they were asked to Indicate why they thought this had occurred^ 

Finally, they were . asked tb coxiipare their own assessments of t&e students* • 

. ■ ■ ' • ^ • .... _ ■ ' . ■ ' 

language proficiency with available scores from form! tests oif l^nguAge. 
proficiency, and discuss reasons for any discrepancies between their own 
evalxiatlons and those of the tests. 

There were several reasons for developing this, particular project as * 

, • ■ - • » ■ ■■ ' 

a mi<^ans for teaching teachers how to do ethnography. Flr^t of all, other 
approaches to classroom communicative competence did not seem compellingly 
promising. The approach most consistent with the Instructor's own : . 



research and writing, and one <iuite consistent with the first part of . 
the course, would h6»ve been to encourage the teachers' identification 
of cultural patterns in •classroom lan'guage use that are spicific to 
the Mexican American connuunity, and that could be. affecting either 
children's perforoiance on formal tests of language proficiency, or 
their ^general achievemisnt patterns. o 

Hoveyer, identification of such patterns would have been difficult 
without concomitant attention to such patterns in Mexican American 
community contexts where they are likely to be more readily in evidence* 
So it was thought best to reserve this approach for the final section of 
the course. Bad the instructor's research backgrotand been in Mexican 
American language use, rather than Horth" American Indian language use, 
this is the approach that would have beeii taken^ 

A second possible approach would have beexv to focus on contextual 
V^iriation in children ' s use of language, in the classroom and on individual, 
student^' variation in language use skills depending on the situation. 

' - . 

• t . - • » 

The purpose liefe would have^been to. make teachers aware that one cannot 
determine the overall nature of a child's language proficiency from any 
single conteqct anymore 'than one can on the basis of a language proficiency 
test. However, to^^^take this approach would have been to assume that the 
teachers were in fact unaware of the children's variable behavior, and it. 
was not clear tlaat they were thus unaware. In point of fact, it was txot 
known how teachers in bilingual prograios go about evaluatijag their students' 
language proficiency. • ' . / . > 

Ultimately,- however, th? primary reason for focusing on the description 
and evaluation of the teachers' language proficiency assessment processes 



was practical, Tlie purpose of the course was to prpvide/the teachers 
with knowledge and skills that would te useful to them £n carrying out 

language proficiency assessment activities. That purpose presupposes that 

. . ■* 

bilingual teacheris have and shoxild have an important role in language 
^proficiency assessment. Yet in practice » the teacher's role is ambiguous, 
as WM indicated in the Overview of the course. Teachers obviousjly have 
far more opportunity to assess children's language skills thaw other 
school personnel, and they act on those assessments in their roles as 
teachers continuously. Yet many of them feel that the major academic 
decisions based on language proficiency assessments, such as who will . 
be placed in what program, ar.e out of their hands. And it is cleair^that 
teachers often lack crfedibility with administrators in such decisions, 
so that , for example, the Results of a test can be given priority over 
a teacher's evaluation of a child's language skills. Why they lack 
credibility ^is not clear. This state of affairs exists in a vacuum of 
knowledge about what teachers actually do when th^ assess their students' 
bilingual language proficiency. , 

A description of the way in which teachers decide who speaks English 
and Spanish well or poorly should be useful for a number, of purposes. 
For the teachers, it ''should help thm become able to articulate to others 
Just how they make their decisions, help them substantiate their decisions. 
in dealing with administrative personnel who doubt their abilities in. this 
area. It should also enable them to' more easily engage in self- 
^evaluation of their own 'assessment procedures, ps^icularly when their 
descriptions can be compared with those of other teachers so that they 



can learn from one another ii Such description also enables them to ^compare 
their approaches with that offered by outside resource -people, in this 
case the instructor of the course. 

For educational administrative personnel interested in improying 
bilingual language proficiency assessment ^;€Pcedures, &uch ^descriptive 
informatipn should be useful in deveLoping a more systematic approach- to 
the incorporation of teacher assessment processes in the overall a'ssess-*.. 
ment of bilingual language proficiency* If administrative personnel agree 
that tests are alvays limited and quite specific in vh^t they assess t and 
that additional sources of Information should be used in making decisions :« 
that will affect students V academic experience, then the " teachers V 
assessments are a natural, logical, evident and useful sous^ce of informa** 
tion« But the teachers' assessment procedures cannot bei used systeznatlcally 
if no one knows wha^ they are. 

. . . ^ . * 

For aJi these reasons the teachers' research project 'was developed. 

As*was indicated earlier, in-class activities for Part II of the course 

entailed precsentation of material that ^would be useful to the teachers 

in carrying out. their projects. One such activity was the presentation 

and discussion of properties of language use that the teachers mig^it 

wish to focus on as a fundamental part of; their assessment process. SDhey 

were given a handout that , encouraged them to consider which^*alf any , ^of 

the five aspects ^of communicative competence discussed earlier Cattention . 

structure, turn economy, etc«) entered into their assessment. 

In addition, t^ey had been given transcripts of classroom interaction 

flrom both Jbaglo and Indian Qlassrooms along with the paper by S. Philips, 

.■ , 

/•Getting the Floor in the Classroom,*' Discussion df the transcripts and 
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^ . the paper focused on the fact that teachers ohviously ratify utterances ' 

V- . of jonj^ atudentai more than others. An effort vas made to characterize the 

; itapecta of laxiguage use that were being thus ^explicitly evaluatede The 

aajjects of language use heing evaluated included: 1* The factuai^ 

correctness of the child's Utterance (e*g. cats dbn*t' hark) ; 2* The • 

• -. « . . .>■.'-' , ' ' . ■ • ■ ^ " 

p • ■ ' liaguistia appropriateness of the child's, response in terms of word class 
V--- . ■* • . ■ ■ ■ ■ • ■ ■ .. ' ■ ■ . ' ■ ' - . 

categories (e.g.MQ: What did the hird do?** A: "Pj;;etty" - is rejected 



r 



[ 



because i^t- isn^t a .verh^ 3,i The topical relevance of the child's 
Utterances li^.. Whether the child was talking out o'f tupn} and 5v Whether 
the child's use of - anaphora was, appropriate -^l.ee could the referent 
be identified? The list was not meant to be comprehensive (because it 
was baaed on It small set of 'transcripts)^ but rather suggestive, and the 
teachers were again encouraged to consider whether they rely on any of 
these aspects of language use dn their assessmerrts* 

Through lecture presentation, the' teachers were acqjiainted id^th Ba^ 
Berzistein's characterization of elaborated and restricted \codesV The 
teachers were encouraged to consider whet h^. they negatively evaluate isuch 

-, , - - a . . • 

features of '^restricted code" as shorter' utterances, coordinate but not. 
subordinate clauses and heavy use of anaphonic prox^guns* Bernstein's 
account of the relationship between code use and social organizational ' 
features of language socialization in working class versus middle class 
homes wai also explained, to stizmxlate the teachers' thinking about issues 
that would be focused on in Part III bf the course. 

Finally, the Bili.ngual Syntax Measure was reviewed« 

The first paper the teachers turned in described their student ranki.nga 



Q gt Spiwish and English proficiency, the criteria underlying those rankings, . 

ERJC - \^ * . r\tM 

mmam the language use situations observed by the teacher on which those- 27 



rankings were baaed. T&en during the week that the teachers were tape 
recovMns tbBir clBSse^ 9 the instructor went over their first papers -to 
pu3i- together a report to give back to the teachers which con^aJ^ed their 
approaches so that they could learn from one/another. The salient features 
of the teachers '^descriptions (mpst of which' were reported in class) 
included the following: * ^ " 

1. Many of the criteria for language proficiency that the teachers ' 
said they use were-vfery academic in orientation. Quickness of ^dents^ 
responses J reading coizjprehension, ability to girasp new concept .readily , 
and ability to do tasks independently are examples of such criteria. JPor 
the teachers, then, language, proficiency is merged with academic achiey^^ 

.ment to some degree/ vEiis is not surprising. /In practice probably all 
of our language proficiency assisssments are situatio^al/domain-specific. 
Since teachers' main prof essioMLl "function is the evaluation of academic 
progress, it. is appropriate that .those asp^ts of language use which ' 
reflect academic achievement would h^/the salient in their conscious 
discriminations.. / 

2. Most of the teacher^identified features of linguistic structure 
am on g the dimensions of language use relied on in otakitig language pro*- 
ficiency..aissessm«ts^/ Sy^^ yocabuiary were most df ten mentioned 

as • aspects ' attended to, but eiamples were too infrequent for it- to. be clear 
what was intended./^6e4iJSi?*^t|l*v§St4S2lr^?^^^ • 
synonyms, and tixe less recourse to the other language, the more proficiency. 
Proper word order, partiOTLLarXy having the adjective before the notm in 
SngXisb and after the. noun in Spanish, wag one syntactic efiterion teachers 



mentioned in class. Correct use of verb tenses and syntactic complexity 
were also mentioned. ITo teacher mentioned pronunciation as a factor in 
these papers. Greater fluenc;^ was also taken as evidence of greater 
-^proficiency in Ijoth Spanish and English. 

3. There were several often-mentioned aspects of language use that 
were specific to the assessment of bilingual as opposed to monolingual 
language proficiency. Code«»switching or mixing of language was mentioned 
repeatedly as evidence of less language .proficiency. While the teachers 
recognized the social genesis of code-s^l;ching and did not view, it as 
stigmatized, alL of them were committed to ^^rograms in which Spanish and 
Qiglish were kept separate, so that for any given lesson, or participant 
structure, their intent was to use only ojae language for the entire 
activity^. Thus while their students entered their bilingual 
with much mixing of languages , the teachers made it clear that th<^- sti:uients 
were to try to stay in the one language in which the teacher initiated 
the learning activity. Given this approach, switches into the /'other" 
language were interpreted by the teacher as ^evidence of lesser control of 
the language of the lessgn. 

The teachers' also repeatedly mentioned "thjs. language of the home" as 
a -dimension- of their, as^ssment process. In other wbr^ds, if the teacher 
knev that Sptoish was .spoken in the student Vs home, she was likely to' 
attribute more proficiency in Spanish to him or her. This aspect of 

language use was set aside tmtil Part III of the course. 

' * ■ . ■ . " • . • • ' ■ ■. ' ' ■ 

k. Most of the teachers indicated that they rely almost exclusively. 

, •* ■ , . , ^ ■ . 

on organized lessoa actl^vl^es in which they cojitroUed the' interaction- 



as %hn contextual basis for their languiage proficiency assessments « All 
of the" grade school teachers relied particxilarly heavily on reading ptoup 
actirLtr> Only two teachers gave. systematic attention to contextual varia- 
tion in children's language proficiency, out in their discussions and more 
ixiforMLlly in other reports, there was discussion of contextual variation 
in amount of student taJjc, presaging the emergence of ^amount of talV* as . 
an important variable in bilingual language proficiency assessment. Two 
patterns of assessment "rffcre evident in this ^^ealm* First, some teachers 
indicated that they were uncertain about the proficiency of thfeir lowiest . 
ranked students because the children spoke so little that it was difficult 
to evaluate them. Second, some teachers indicated that they had students 
who spoke very little when the whole class met with the teacher as a group' 
where participation is voluntary," but were, prof icliiently .responsive in 
small groups where everyone is expected to take a\turn* Because of this 
second pattern, the teachers were unwilling to associate lack of talk with 
lack of proficiency and felt this second group, may get unrepresentative 
scores on 03:^' language proficiency tests* \ 

5- On the basis of the teachers* descriptions ahd the instructor's 

^ ■ ' • ■ ' ■ * . • ■ ■ . \ - • 

observations in six of the teachlers' bilingual classrobms, it became 

evident that there is rarely if ever complete functional equivalence between 

^Spanish and English in such, classrooms. The two languages are always to > 

■ ' • ■ - ■ . ', ' ■ . • 

some degree used for different purposes. 

The most cdmnion pattern in the early grades was this: The school 

-« - ■ . ' - ■ ' .. 

day tegan^with the whole class njeetiag with the teacher, and the activities 

Of this time (Pledge of Alleigiaace, calendajr review, foil call, announce-; _ 

menta) wer^. alternately ia Spanish and English, with alternate days or 



veelcs for each* The reading groups were either always In Spatxish or 

alvays in English t ^th brief stilted forays into the other language 

through TESL or SESL that most of the teaches vieved as ineffective. 

This should cause us* to question whether the transfer of reading skills 

from Spanish to English can be matched by a transfer of the verbal iangua:ge 

- ^^^^^^^^ 

use skills associated with reading groups • Math was the academic activity 
most likely to involve preview/review alternation in both laxigu^es, 
but here too :fqme teachers reported staying in one language. All of 
the teachers seemed ta* have a better sense of the students* competence in 

one language 9 ustxaXly Spanish^ than in the. other, and they made this clear 

, ' . - • . ■ ■ . . > ■ . . 

in their descriptions* 

By the time tills first paper came in, it wi&s apparent that the people 

taking- the course were overwhelmed with the reseiarch project as a whole. 

The two main concerns were^first that they Were being ausked to do tasks 

that they^lacked the skill and knowledge to do, and second that the project 

required too much time and energy, was too much work* . Because of this, 

the Instructor developed a final format fct the analysis of the taped : 

transcripts that was mope structured and limited in form than had been . 

.... ■ • . _ . " 0 . _ • ■ • 

originally intended* First, r,at her than requiring the^^Leachers^^^ 
operatlonalize their own criteria (e.g. decide what constituted evidence 
in the transcript of good oral rj5adi|{g or verbal fluency qr complex syntax) , 
the instructor selected and operatlonali zed most of the criteria to be . 
examined, using the/ following format; , * 

1. First the teachers were asked tci look at two features in both 
.English and Spanish from the Bilingual Sjmt ax Measure. . For each language 
one f eatttfe that is thought .to be acquired relatively early was used 

- 31 



(presence of CLrtlcles, e,g. 1&, el; thet a) and one featiure acquired 
relatively late (direct and indirect object pronouns in Spanish, and 
the Past irrecular tense for verbs in English). These" pairticular . 
features were also chosen because it was expected that they wotild occur 
relatively freqjxentlyt The teachers were asked to give the number of • 
•^correci" uses of these features in relation to the number of instances 
where they should have occurred* . 

There were several general reasons for drawing features from the 
Bilingual Syntax Measure « First, that test is based on syntactic features, 
and a number of the teachers had said they attend to syntax in making . 
language proficiency assessments. Seqond, it seemed that use of the test 
features would facilitate comparison of test features with teacher-identif led 
features. Use of such feature^ would -al^o facilitate discussioii of their 
occurrence in a test situation conipared with their occurrence in ordinary 
classroom intieractlon. Finally, because the teachers hiad expressed so much 
uncertainty over the assignment and viewed it as too difficult, it seemed 
important to^give them some features that would be easy to identify and 
easy to count in their transcriptions.. 

■ ■ • . ■ " ■ ■ . ■ • . ' . ' A " ■ ■ ■ " 

2« A third feature the teachers were asked to examine in both Spanish 
.and English was the frequency of code-switching.', this feature of students' 
language use was identifle<i by the teachers as one they rely on in language 
proficiency assessments, and because this aspect of language use is 
dlsl^nctlve to bilingual language proficiency assessments, it seemed an 
appropriate v»iable to examine for this cou^^ - 

3f For a fourth variable, the class as a group was given a choice 
f rom attohg four possible features that they had identified as- tfele^^ in 



their first papers, and that the instructor had Judged to te readily 
deflneable. From aaong these, the cJLass members identified fluency of 
speech as the feature they felt vas most promising. As a group, they 
• agreed to focus on "false starts" as the aspect of fluency to he exaiained 
.in their transcripts, and as a group they developed a more precise defini** 
. tion of false starts. 

k. For a fifth feature in each language, the teachers vere to select' 
one of their own- that they felt was particularly promising an4 that could' • ; ■ 
he defined in such a way that others could recognize it and count it* 

There were several reasons for the emphasis on operationalization of . 

features of students' language use and qimntificatitDn of hehavioral 

|« ' ' ' ■ ' • • ^ • • • • ■ ■ .■ • ' . . * • ■ 

'^^differences among the students* Fifst, as noted earlier in this report, 

one purpose of this second part of the course w*s to compare teacher 

language proficiency assessment with the assessment format of tests. If 

quantified, the teacher's foci of evaluation and relative ranking pf students 

Gouid he more directly compared with those of the tests. Second, it seemed 

important ttf d%termine whether the teachers could explain to others what 

-ther do in a wa^ that would enable others to look at the same aspects of 

language use tluit the teachers look at, and thus evaluate azid systematically 

incorporate teacher aissessment procedures into routine language assessment 

in. the schools V . \ 

Durinff the third part of the course, the teachers were given a summary 

of ,their Part II final analyses by the instructor that covered the following 

pointst ■ 

1. Most of the people who taped and transcrilsed their tapes taped 
reading groups^ usually in Spanish^ The heavy tise of reading groups was ' 



partly motivated by the fact that this is probably the main sitxiat ion in 
which verbal language use is asssesssed by teachers • The second reason for . 
use of this sitttttipn is that it can be taped and the tape transcribed 
more readily than many other classroom activities, and the teachers had 
been urged to consider such factors in. selecting activities to tape* • ; 

2. In the first part of the final analysis » the teachers were asked 
to eompare the results of their analysis of their students V language use 
scores from language proficiency and aqhievement in the students ' records^ 
The teachers found the records to. be poor and spotty. Some could find no 
stich information for their first gtsde level student s* The' scores avaii-. 
able to the different teachers were from different tests » making it clear 
that there ^vas no standardization in testing in th^ school district * ITone 
of the teachers found an absolute correlation betveen their own initial , 
rankings of their students and the results of language prof iciency tests , 
although there was a general correlation^^ Conflicting rankings weire 
usually in the-.top half of the groups of students in questions^ and most 
commonly involved one child who talked a lot , and vas, evaluated more, highly 
by the teacher than by the test/ / 

ffone of the . teachers attempted to esgplain discriepancies between the 
tests and their own rankings as they had been asked to do* . 

All of those who finished their assignments rejected the features 
from the Bilingual Syntax measure as useless for theix" purposes, just as 
they had been verbally very critical of the test when it was earlier dis- 
. cussed ia class* Generally they said the features in both Spanish and English 
were, completely or almost conijiletely controlled by all of their students, 



Including all of the stxi^ita at the first grade level* Interestingly 
enough^ they all also found that direct and indirect pronouns occurred ' 
too infrequently in their material to be effectively evaluatisd, suggesting 

• that whatever uttearance types normally display pronouns in Spanish are 
not heing generated hy reading group discussions* The suggestion of 
one teacher 'that English verh tenses in general rather than the Past 
Irregular he considered as a useful indicator of linguistic control was • 
supported by the others in the class in- class discussion* ' 

The discussions of the variable of coder>svitching as an indicator 
of lesser proficiency were among the most interesting in the teachers' final 
a]j:alyses« None of them ended up concluding that this dimension of language 

/functioned as they had initially expected it to* Some members of the 
class arzlved at the opinion that there was more code«*switching amqng 

■ ' . ' ■ ■ ....... . V . • ■ • • - 

the students they had ranked as most proficient in a giveii language in 
question rather than less* Class discussion of this finding indicated 
that students with good code-switching skills are generally perceived 
by the teachers' as particularly conqpetent or naturally gifted in language 
skills* - 

The instructor informed the teachers that her comparison of the - 
different papers and transcripts indicated that there was more codfe^switching 
from Spanish into English than from English into Spanish. Transcripts and 
observations from five different first grade classes izidicated that in both ■ 

languages tbe- amount of code-switching done by the students was roughly 

"* ■ . ■ 

proportional to the amount of code-switching done by the teacher. In 
other words, in classes where the students" switched a lot,. so did the 



teacher, " In classes Where the students switched not at all, neither did 
the teacher. It is not clear who is conditioning who in such activity.!' 

•'5» The teachers also rejected fluency as an indicator of greater 
control Of the language in q.uestion. The two flrgt-grade teachers, who 
finished their analyses izidependently concluded that disfluencies in 
the form of false starts were' associated with longer turns- at talk 
and rnbre coniplex utterances, which in turn were paroduoed hy the students 
the teachers had Judged to he their most proficient, ,Tliis finding, led 
the menthers of the class to agree that turn length and utterance comolexity 
"might he good features of language to examine in future. work of this kindV 

6, In general., the teachers were more enthusiastic ahout the utility ; 
of the features of language i;se that they had chosen on their qwU; than 
those suggested hy the instructor or decided upon i^y the group* ^ -'T^ 
featiares included erirors in oral reading, number of student responses 

- acknowledged and evaluated positively by the teacher, amount of talk (by • 
number of turns, number of words, and number of syllables) , correctness ^ 
of all yerb'fotms, and number of words with thre.e or more syllables* The 
teachers who looked at reading and nositive^teacher evaluations foaand the 
strongest correlations with th^ own rankings,. which provides further 

* . evidence Of the extent to which language proficiency and academic achievement 
are merged in the teachers* language proficiency assessments. . ' \ 

. . those who lodked at amount of talk did not* find it to correlate with - 
their rankings,, primarily because there was usually one exception to the 
correlation. But the .instructpr*s pertisal of reports and transcripts- 
taken as a Ijody suggest that iti fact there- is a very strong general correlation 



TDetveen amoxmt of talk and positive or high language proficiency assess-* 
meat of a student • * --^^"^ 

Tr Concluding, remarks.: The teachers seemed to feel that , their 
awareness of the ways their students^ use language had heen heightened ; 

. hjr the project activities and that /.their own intuitions ahout their students'' 
use of language were only hourne out some of the time when their "^students ' 
language use was examined, more elosely* The experience did not caus^N^ 
to question their otra rankiiigs^ Instead, where students' 'performance in 

• terms of the teachers own criteria was not what the teachers ' expected, ^ 
they tended to criticize the use of those criteria some and the methodology 

of the research project more^ They helieved they were working with too 

. ■ ■*•■'■'• • - • . , ■ ■ • 

little data for the features examined to he confirmed or disconfirmed. 

The instructor shared this view, hut less strongly than th^^^^^ had 

access to all of the papers and all. of the data* it was also clear that 

the feattires we. examined interact with other features we did not examine 

in conroleX Md^ subtle ways , a point again reco^iized hy hoth the instructor 

and those wlio took the coinrse. 

This suggests that it is generally q[uite difficult to ''operationalize 

the teacher assessment processes, and if . teacher judgements are more - 

systematically used in making student, pjpogram decisions in the future, it 

will^prohafely he .necessary to accept the gualitiative nature of tHeir * 

Judgements. . 

^ It was also clear that the teachers' hasis for making language pro-, 

* • ; activities 

ficiency assessments is in fact almost always limited to the academic/ which 

the teacher herself controls ♦ The expansion of that hase to other sources of 

information was the focus of the third part^^^^^ 



Part III: , Communicative Competencct, in the Community 
'The general purpose of this third part of the cqurse was to faqiljitate 
the ^teachers' \ exploration of sources of information on *heir students ' 
communicative competence that they do not normally use a^ a bsCisis for 
making bilingual language proficiency assessments* As in the second 
part of the c0Tirse> the teachers were given an empirical research project 
to carry out. involving gathering of additional information on the same 
students they had ranked in the first project. And once again the in- 
class activities were designed to acquaint the teachers with ^approaches 

• ■ ■ • . • ■ ■ * ■ . • ■ - ■ ■ ; ' ■ .'■*.-■ 

^ that would help them in their projects. This timey howeve the project. . 
was less structured, allowing the teachers to decide how much time to 
devote to it, and readings were assigned to accompany; the in-class lectures 
and discussion. 

Basically the* teachers were asked to consider whether access. to a 
broadened view of their students' communicative competence, would give thea 
insight into t^^je students' in-class langiiage use and/or alter the nature 
-of the teachers' 'ranislngs of their students' bilingual language prof icienc 

The third part of the. courae was designed to broaden their view of/, 
their students' communicative competence in two ways: 1. First, they ^ 
were to consider the nature of contejctuil variation in children's communica- 
tive competence, considering -how the children communicated in school contexts 
the teachers did not normally ohserve, Mid in community contexts. In general, 
thei^, they were^ to try to fit or relate the children's performance in 
academic activities into a larger pattern of commxmicative skills^ They 
were given examples of research carried but by William I*abdv in a JTew , * . 



'fork; alack community and by Susan Philips on the ' Warm Sprinss Indian 
Saservat ion that indicated that the children's ways of communicating 
vere quite different in situations that did not involve a teacher than 
ahey vere when the tjeabher organized the interaction* The puSrpose of 
zzcBc examples was to encottrige theia to recognize tlxat there might very \; 
veil be more to their children's- communicative skills than they were 
seeing. ^ . ' ;" 

2^ The se<iond way in which the- third section df the :Coiu:se was to 
croaden the teacheir?' views of their children's cqrnnnmidat^^^ competence . 
vas. throTigh consideration of the relationship "between the students' social 
sackgrounds and their language prol^iciency as it^^^ by * 

zcA teacher on the basis of academic' activities. Here the concern was 
zo further, develop, the notion, d;|,scTissed earlier, that culttgal differences 

socialization for communicative pompetence can be lased to explain some 
rcbr achievement (and low language proficiency assessment )./ The teachers 
vere familiarized with a n\jmber of aspect^ of social background that have 
ceea correlated with school performance, andv^that can be seen as part of 
a child's ctLLture; ethnicity, social class and, in the. case of the Hispani< 
copulations, number of generations removal ftoa immigration to the United 
States. ' 

While the Part III Assignment encouraged the teachers^ to consider a . 
cuaber of sources of information, problems with the Anthropology Department 
Humans Subjects Committee made it necessary to ask them not to make visits 
to students I homes to gather information or gather infomiation ffom their 
school files. Thus they came to be limited to observation and tape . 
.recording 9f activities taking place on the school grounds, and information 



about the children that they had acquired during their normal teaching, 
activities. Those who ^ad already gathered additional backgroxmd ; , 
iafonpation ftrom other soWces before this restriction was made were 
' allowed to go ahead jand use th?^^^ information in their .final papers./ ^ 

There were three topic s\ covered in class sessions designed to provide!^ 
information that would facilitate the teachersV data collection and 
anaOysis. The first topic was ^oger Barker's sociolinguistic . study of 
Tucson. The teachers jwere. assigned his book reporting that . stiidy, for 
several reasons. First, it was thought the study would give them an 
overview of the patterned relationa\among codes used, the sOcial domains 
ia which they, are used, and the social categorization of persons usinig 
them. Second, it was thought that because the study was done in Tucsoii, 
it woiiLd stimulate the teachers to evaluate the stMy and use- a mo^i 
version of Barker ' s categories in 1:he±r ora. analy?is, of. their students 
language use. ...... ' A '* ■ ' - ■ 

'In~class'. activity centering arOund theABarker book began with a . 
discussion pafticipated in by all, of their linguistic and social- backgrounds 
so that in evaluating the book,' we would all Imow the natiire of each person *s 
knowledge of the speech community that Barker mui' stxidied: To our surprise, 
only one person in the. clasg* (and she was not ofAHispanic; origins) had 
growu up in Tucson- By far the most common pattern was for the individual's 
parents to have iinmigrated flrom Mexico to a small mining town in Arizona, 
and for the teacher not to have come to Tucson untilAshe went to college 
here. The teachers were thus hesitant to comment on W continuing rele-?- ? 
vance of Barker^s Analysis of the social organization of the Mexican 
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Amftrifon coimminity, but: quite filing to* offer alternatives to his linguist ic 
typology .of codes uied by the commnnityl , : ' 

Barker divided the cddea used in the Mexican Merican c^ into 
Sonorma Spanish, South«rn, Arizona dialect of Spanish, Pacfauco, Standard 
Mexican Spanish, Ilonstandard English, and Standard EngUsh. The teachers 
offered severai apparently more "«nic'* categorizationa of Spanish to cover. 
th« Sptnish range: 1. 2U£o: Horthej?^ Mexican and Me^ 
Spanish; a. front era ; puro laced with anglicisms; 3. pochi/ipocho ; similar 
to front erSj lmt with the inclusion of arch&ic Spanish'^tS^ and the 
connotation of small townness "and non-standardness ; nachuco * The 
teachers disagreed about the connotations of these words, and did not feel 
that the typology was complete. Ihey were encotiraged to use i:hese . v 
.categories in diarcussing tEeir stud?tnts'. language skills in different 
contexts, but none did. ' 

The second'topic developed to facilitate the teachers ^ projects was 
that of code-switching. As has already been noted, the teachers were very 
concerned a^ottt. how to interpret and deal with, code-switching,* and it had 
emerged as an iinportant feature of their language assessment activities. - 
Their research in Part 11 of the . course suggested that the phenomenon 
WM complex, but they still felt it was important in language assessment. 
They were encouraged to consider the nature of their students* cqde- / 
switching in diverse contexts and to re-evaluate its significance for . - 
bilingual language proficiency- assessment • > . ' 

In class, various aspects of patterning in code-switchihg were reviewed, 
includingUts correlation with: topic, language best known 'by addressee, 



. degree of formality of the occasion, and the desire to "giye symbolic 

; - /fxpreision to oaeta culttvral i^^ Consideration vas also given to 

* * ■ ■ ' , ■ ■ . " • , ' ■ • , ■" *.■ ■. ■ ■ . 

the different types of iinguiatic structural*units th9.t determine the 
Jmctxarea •t which switchiniaf actually takes pla«e. The possihiiity that 
lesser proficiency in students* language use might he signalled hy . 
• : svitching vithin these linguist ic*" unit st (i»e. Svitching th^t violates 
^ . / rules for appropriate switchingj was raised* 

p / The third topic developed to facil;Ltate^ the teachers* projects' was 

the nature of cultural difference ii and their consequences ^ 

j{ for patterns of language use*v. Differences in "knowledge** had already 

been identified in Fart II asi an aspect of conmiunicative competence that 

L - the teachers Mght be evaluating, but this notifin had not been dealt w^^ 

V . in a thorough and systematic manner. To illustrate what was involved, . 

■*f, • . • • - ■ ' ■" . ^ ■ . . . ■ - 

and its Implications for classroom interaction, the instructor presented 
lecture material aniO-yzing i^. transcript of Warn Springs Indian first^-"" 
* *. ; graders engaged in a. discussion with their^ teacher i focusing on an article 
' * in a Weeidy ^Reader called '*Can^)ing Then and IJov. '* The trahscript illus- 

'-: trated the difficulty* the Anglo teacher h|id getting the childr«r| to talk, 

and the freq,ueney with which, she defined their answers to her q,uestions 
■ ahotit their 'own "camping'^ experiences as inappropriate in^ne way or . 
^ , another. The instructor e3q>iai^^ 

"caiap," the natiire of the activities iiivolv^d, andythe meaning of the*. / 
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term caalp are different, and «ahieaded4n'^rathe»^ffisrent cultxiral maitricesi 




■ ^ . • Thus cgm£ is used by Wot Springs^lndians way that stay is used by 



AniBios, tod stay is used by Ihdians as Xive • is"ttg^ed.vby Anglos, Thus 



one CEn be invited; to ^cmp here" for the night aaid it Qm mean . stajring 
in the invitor's home^ When Indians do caigp^. in more of the sense meant 
by Anglos, it usually involves visiting relatives; a pov wow^ or engaging • 
in food*-getting, such as fishing or. berry;-picking at traditional Indian . 
slates » and not a stay at camp grounds in a park in a pretty place* .. 

' Such differences in the, natxire and organization, of esqperiences can 
catise people fjrom different backgrounds to have difficulty understanding ' 
one another and isuildlng on one another's utterances in a meanizxgful vay« 
Curriculum materials often 'presuppose particular ty]^s of experiences 
that only children from some background have had, ISxe teachers were 
encouraged to consider how the extent to which a child's background/being 
Mexican American in culture, rather than Anglo (whatever that means) might 
affect his or her comunicative competence in various contexts or socilal 
Settings in which he or she paarticipates* ^For exuaplei did some children 
display more- language proficiency in non-academic activity because of 
greater knowledge of or interest in the topics being discussed? 

To facilitate consideration of this issue, the instructor as isigned 
.readings *by MexlcaOmerican folklorists that deal with sorts of knowledge 
(jokes ) which only members of the culture- can produce and respond to appro- 
priately. "She also reviewed characterd^^tics of Mexican American culture that 
are frequently mentioned in the ethnographic literature, suggested ways in ^ 
which such characteristics might affect classroom behavior ^ and asked the 
teadhers to evaluate and respon^d to these rather stereotyped^' generalizations • 
The ^2haract eristics, reviewed included: 1. Acceptance of and orientation . 
to hierarchical authority; 2# S^trong social involvement with extended 




•fM^iyj 3. Pat^riafchal orientation within family, aas^eiated with . 
a»l« hou»,«hbld authority, and pr«ferenc^^thai W0^' stay% the home- / 
rather than w^^j k. Strong . involvemeat/dyk'^e Catholic chtirch ; 
Continued , involvement with "ourand^^cdmplex of heliefs ahptit the ^.^^ 
(u|*matural and the treataient o^^^^essi 6^ More musl^al^offentation. 
in social .activities (singi^^^d dancing) . . /^ r^'"" « ■ • 

. Because, these viej^;^^ so sterotyped and hav^Jbeen criticized V . 



s^ome Hispanic goci< 



ientists, the instructor priesented -them with some 
diffidence, ^d onjif fgr laclt of other^^laterials, h^^ of the teachers. 




felt th^jT'^wereXqciarate .characterizatibhs of Mexican Merican c'tilture, 

disct^lpfi. of these qualities , the^eachers 'gave several examples of 
ways^^^^hich this iDaclcgrdund affects what their students discuss with ' 
ithtisiasm and interestv One teacher menti^n^, for example, that whtn - 
./he, tried to get her first-graders to ^discuss media events they have. seen. 



she first tries to question tlh^^^^ut popular Spanish language movies 
showing in towii, b^cawse^^^ows the children are likely to have seen 



those. ■ Aaothef Jeacher/m^ that her children try to talk to her" 

■ ' }/ ^ ' • 

about the ■actimties .at the Catholic Church they are involved in, or 
may make- refj/ences to Bible stories, but she feels she cannot develop 
these top^ ' because oj: the church-state .separation pressures in the 
school^^owever , none of the teachers addressed such issues in their 
- papejps*. ^ : o .-, :. 

Of the five people taking the course who reported on the Part III 
assignment , three concentrated on, .observation of their students" in contexts 
: where they did not normally see them and two- concentrated on the relation- 
ship betveen features of the students' social backgrc^d and their language 

■ ■ ■^ ' : ■44." ' '- '■'■'r'^y- ■ , : 



proficiency in Spanish and English. Their general evaluation of. this 

y . ■ ' • ** ' • ■ ■ . ■ 

project was that it was very useful to carry out sxwh" activities , and 
one gaiaed insight into the nature of the children's communicative skills 
ti»t cotitld aot gained through regular class^^^ activities* • 

Two of the teachers who ohserved the stxadents is activities on the 
^school grounds . found a general correlation ^hetv^een the students' amount 
of talk in these situations a^d in the classroom* More particularly , 
they found that the students they had ranked as least proficient in at 
least one language were loners. Qutslde the classToom^ and- weren't- talking- 
tecause they weren't with anyone « One person taking the coiirse found a 

child who used Sisanish little in the classroom 9 even when addressed in 

but. 

Spaniisfe, /relied on it heavily in interaction with peers in the cafeteriai, , 
making plfi^usi^le the notion that some students see the classroom as* a. place 
for ; English, no matter what kind , of program they are iue 

The teachers agreed that •^phservation of students in activities not 

* ' ■ '■ ■ •• . ■ . * ■ . „ .* ," *. 

controlled by the teacher shoiald he a regular part of hiiingual langji^^e 
^proficiency assessment* But they felt that for it to he praeti^^ 
would he best to recommend that teachers observis students Jkn unsupervised 
activity in the classroom* They found the cafeteria /to be, an excellent 
situation for observation, but felt some teachers would find it a burden 
to be required to observe there* They found the playground* a visry poor 
place to observe, because, of the level of activity of the children. 

The teachers who looked at the correlation between language p|^iciency 
and social background were surprised by several of their findirj^sV One ^ 




teacher* who teaches Spanish as ' a second language to Mexicair American 
studenti at tixe high school level found thiat there was a strong correlation^ 



Tjeiwe^n the students ^ identificsttion of Spani^ih as their first language, 
and her jpoaitive assesisiezits Pf their present Spanish proficiency. In \ 
other words, heir good" studet^^ vere those who had Ijeen early exposed 
to Spanish, and/or had had it and lost it* Another teacher, who taught 
at the first grade, level found that there was. a strong correlation : 
between high proficiency ia Spanish, and birth in Mexico, and between 
high proficiency in English, arid birth in the United States. While this 
correlation might seem obvious , it has apparently been disputed among " 
those working iii Tucson in bilingual educatioti..^. This same: teacher fouad 

a strong correlation between students' birth order position and proficiency* 

■ * ■ ■ ',■ ' • - ■ ' • . ^ ■ . . ■ . ^ 

Those who were first-bom in their family tended to be ranked as more ' 

' ' * ' • ■'•*". 
proficient in both languages by this teacher. The other teachers strongly, 

agreed that this factor is a very promisins one for explaihing^ 

in lariguage proficiency although the teachers found social back- 

grotmd information helped them explain patterns in their students 

comnuni0atl^€ competence j t^ feel that teachers 

shou3.d^gularly have access to such information, or be encouraged to 

^use it in making placement decisions. They felt such information was 

too biasing, so that e.g. a child who was from Mexico and fourth-l3brn, 

' .' ■ ■ ■ ^ - ■■ . ■ . ■ n . • ..■ ■■ • :• 

would be assumed to have little English proficiency /regardless of his 

,aCtual.J^e^ ^ / • ' 

.. *■ . ■ ■ V ■ .. ■■• ' . ''^ ; ; ; ■■ .•■ ; - . > ■•' 

' Iji the'lastr'session o.f^ the course, where the teachers ijave oral 

y.: ' y. '} [ - •„ . , ■ ^ ^ ' ' ' 

presentafe^hs of their ;pro4ects for the third part of the course^ the instructor 
als^/^^^tf^ the relevance of 

.^m^ competence and ethnographic methodoio for -bilingual ; . 



pai^mtte proficiency assessnfent, which addressed the following concerns: 



Increased, attention is now Tjeing given to Ijiliiigual language pfo- 
flclenc'y assessment because some educators Ipe^bieve that poor assessment 
procedures are contributing to the continued difficulty our school " 
systems are haying in, raising the achievement' scores of Tjl^ingual 
stud«iti. An ethnogrjsiphic approach to hilingual educa.tiQn stresses 
the need to develop assessment procedures within 'a general framework 
that assuiaes ciilture-specific developnental refereiaces in t^^^ 
of communicative conqpetence. It is necessary to empirically deteymin<? 
What those sequences are hefore teachers and curriculum developers can 
biOld on already ekisting coffoitive development in their education of 
the children.. For this reason* hilingual, language proficiency assessment 
in all settings shotild entail hot Jtist evaluation of students^ language 
s fci1 -T ff in terms of an already known and established s<st of criteria* : 
"but also RESEARCH, open-ended exploratory research oh the nature of the 
skills the children actually have, and their relation to academic success. 

Formal testing is too limited a has is for deteinnining the language 
in which a child should first acqtiire. particular skills. There are a 
number of factolf that should he. considered in making such decisions^ 
The main concern, of course, is that the child he taught in the lan^age 
in vhich she or he has the skills to learn, to acquire knowledge, to think 

•^creatively. . Thus far It has heen assumed that this should he the language 

ia which the child is "dominant." But a' child may .he djQminant in one 
language for some topics and- some social domains , hut no\: • others . Thus 

.we see immediately- ihat 'dod^nance is too ^ s^^ notion. To determine./. 

the child's hest, language for learning, we should minimally consider the 

■ f ollowing's . 



• 0 




-42- 






In which language doea^.the child have skills most directly • ; * 


s 




rtlated to what schools teach? This may mean the vocabulary . 






of words teachers use in teaching reading. . It pay mean . 






the ability to answer questions about .evente in books, and 


t 




the ability to re*-tell stories. . ' 




• 2. 


la which language does the- child show the greatest ranare? 


: L 




In which language can she handle the greatest diversity of . ' 






topics and social situations? 




3. 


In which language is the child motivated to learn? « 


: . L .. 




la which language do the parents want the child to learn? 


r 


At present we do not .Imov wlii,cli of these factors matters most* But ■ 


L 


at present only a nafrow dtaeasion of the first factor is beina used to 




make decisions abstit children's placement in programs . 




A bjwader view that encompasses all of these factors would entail- a 




broader assessment of bilingual language proficiency that incliided ' 




followirig: ■ 




1. 


Formal testing. 


■ f • ' 

( 

; J - 


- ' 2. 


Teacher observation of student * s language use in academic ' activities . 




• . 3- 


Teacher observation of student's language xxse ia peer act:^vity, ■ 






in clMsroofli or cafeteria/ . / i 


r • . . 




Informatioa about language use ia the child's : home eavi3?onmeat— 






who uses . which language ia what contexts, in dealing with wiwtt 


■ tl ■ • ^ 




topics.- • ■., • ', 




With this information, it should be possible to determine iri which languag,e 




the child has the greatest range, and in whiSh language the child has 


r„? - 


"school skills.". In practice i it ts likely that working-class children 
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will have fewer school sJcilla in either languflge than middle^lass 
children* It would thus "b^-^ipprbpriate that they he taught in the 
Ijanguage of greatest^^?«toge, heqauge J^hia is the laxiguage they are. ajost 
likely to pidtjiir^ev skills in, For middle-claas^ children, thevlanguage 
of schooi/S^Hs and great range may "^e the same or different • In any 
caafOhe. stress on a narrow set of school skills has worked poorly, , 
IQ .there is a great need to try another approach, and emphasis on initial 
development of the language of greatest ranfflt is a very promising- avenue 
at this time* But range can Only he established ethnographicaUy, and 
within a framework of cultural relativ^«ia, hence the utility Of the con~ 
cept of coBBCMnicative con^etence fojp^^iilingual language proficiency, 
assessment* 

Bistrtictor ' s '"B^^ 
1^ In general I felt the contents ot the cowse vtfte apprppr^^ 
to the level of sophistication and intelligence of the students ^ in spite 
ot their -heliefs that they could not handle* the project in ^Part II. If 
I -W^re to teack the course igain, t wuld have to change the project, v 
•regardless of my belief sV hecause too iaany students vere too negatively 
affecte<?l V i1<* Roughly half of the^ dozen who intended to take the 
course for credit dropped out during this period. I would prohably keep 
the first part of the project in vhich the teachers r^aaked students and 
identified crltearia and situations they use in making bilingual language 
proficiency assessments.. Instead of the rest of'the task as it was, I 
would .have them tape and transcrihe two • situations — one that 'they 
normally tise for making assessments, and one in which the same students 

■ : : : ' ■ ■■■■ : > 49-- ■ 



will have fewer school skills in. either language than middle-class . • 
children. It would thus he appropriate that thejr he taught, in the 
language of greatest range, hecause. this is the language they^ are most 
iikely to pick u|> new skills in. For oiddle-claas children, the language 
Of school skills and great 'range may Tje the same or differeat. la any 
y caae, the stress on a. narrow set of school' skills has worked poorly, 
so there is a great need to try another approach, and en^hasis. on initial 
development of the language of greatest range is a very promising avenue 
at this time^ But range cait only be .established ethnographically, and 
within a framework of cultural relativism^, hence the utility of the con* 
cept of communicative con^etence for bilingt»l language proficiency - ... 
.assessment. . ■ . .. '- 

Insl^iTUctorVs: Evaluatioii and^.R^ ^ 
1* 'In general I felt the contents of the coiurse were appropriate 

■ ■ ■ ■ • . v . . ^ ■ - ft ' ■ ■ . ■ ■ ■ ■ ■ > . ■ , 

to the level of sophistication and intelligence: of the students, in spite 
'Of their beliefs that they could not handle; the project ia Part II. I'jp 
I were to teach the coTirse again, I would have to chauage the project 
regardless of my beliefs, hecause too many students, were too negatively 
affected by it. Roughly half of the dozen who intended to take the 
coxJTse for cretiit dropped out dtirlng this period, I would probably keep 
th^f first part of the project ift whicli-the teachers ranked 
identified critearia and situations they use in makizig bilingual language 
proficiency; assessments; Instead of the rest of the task as it was, I 
would have them tape, and transcribe two situations— . one that they 
normaily .tiae for making assessments, and bne in which the same' s.tudettts 



wre unaupflirvlsed or peer-oriented. Then I would ask theni . to make generea' . 
comparisons of the students' proficiency in the^tvo situations in terms 
of code-switching* topic control and other dimensions of communicative 
competehqe, aad to re-evaluate their ranlciriga. . 
Zm A coiirse that is etlmographicall 
, he tatight* after the teachers* have* other baekgaround in language study, - 
Thus teacher trainixjg needs to include in the foUowihg order; " 
a* Undergraduate ^ all teachers 

1) ^troductjott to Structure of I>anguage • - 
' 2 ) Socioiinguistics ' 
b. Graduate - "bilingual/ethnic miniority teachers 
, 1) Analysis- of Tests and Testing Procedures in Bilingual Education 
'■ " 2) ito Ethnographic Approach to Biliiigual Laagu^^ 
- . . Assessment 

. Pearsonnel '< . : 

The instrcictor's hackgromd in Spanish was limited to three years v. 
of poor high school training and one semester of college • Because she ' 
was not functionally bilingual » it was crucial to the workability of the 
course that her two assistants were bilingual in Spanish and English, 

1. Teaching Assistant (Olivia Villegas) The TA did library research 
fciir the instructor and obseryed in the classrooms of those taking the course- 
acting as an intermediary between , them, and the instructor in the development 
of their projects..; She also functioned as a bicultural ethnographer, of , 
of the course activities* offering invaluable insights to the instructor, 
in this capacity. *' ' ■ ' "'o ■ 



2* fieaeafch Assistant (AdaJb, Leah WQlf ) In, the first part of 
the course , the R.A. tape reeoried and transcrihed interaction in Sp^ish 
ftbai a variety of settings to faniliarise the class vith the range in 
thW formr-function relationship in Spanish that could Jie obsisrved through 
suchr data collection. For the second and third parts of the course, she 
dnplica.ted the data gathering: of the teachers' Assignments itn an addi- 
tional, class so that the instructor coiild analyze da:j^a along with th<e 
teachers and. gcLLn insight into the issues of concern "to them. 

> .■ . .... - -V 
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Introduction / 

The research reported (n this paper was fmplemented under 'the Assessment 
of Language Profrciency of Bilingual; Persons (ALPBP) project. The two-year 
project Is funded by the Natlonar Institute of Education (N IE) and adtn^is- 
tared by InterAmerlca Research Associates. 

The, purpose of this paper Is to describe the teacher training program 
, Implemented over a two year period In CQoperatlon wI.th Tucson Unified School 
District (TUSD). TUSO was selected as 'the- training site for the AUPBP project 
because of the dlstrlcfs Interest in the developraeftt of innovative approaches 
to the education of language minority students. TUSD serves a coiwnunlty • In 
excess of 500,000. Approximately 57,000 students are enrol led In TUSD schools. 
Approximately 16,000, or28.4%, are;'f^ispanlc, of wh^ch approximately 11,000 have 
been identified as having a primary language other than English, In addition, 
the school district also ■services about 1 ,000 students from 79 various language 
backgrounds. • » _ 

TUSD admin rst rata rs tel t that the ALPBP teacher training .program In 
ethnographlc/s'oc'lol ingulstic methodologies would complement their efforts In 
developing a nontradl tlonal language proficiency assessment instrument, the 
Langua<|e Proficiency Measure (iPM) XTUSD, 1 981 ). The educators who became 
involved In the training program were teachers" and admin {strators from the 
school- distrlctv District administrators had an op^portunity to input in'^thW 
content of the program during the p I ann I ng stage '»th rough a variety of phone 
conversations and on-site meetings.' Teachers had.an oppbrtuni ty ti contrl- 
bute, to the training plan through a needs assessment survey and formal and 
informal meetings/ ^ 5S 



The general goal of the train | jig component of the Aj-Cp BP project was to 
provide a forum wherein teachers and admUitstrators would explore the application 
of .ethnographic/sociol inguistic theories and methodologies appl led to language . 
-prof ictency assessment practices. In order to accompl Ish this g[0al , bi lingual 
and mono 1 ingual educators were provided with a background in 1 in^iii sties, 
sociolingui sties, ethnography of speaking, measurement, and research methodology. 
TTie expected outcome of the t/a^i^^ that it would enable Tucsion educators 

to- develop more effective language proficiency assessment strategies applicable \ 
to their particular student population. 

The process of establ ishing a relationship with TUSD administrators, and 
•teachers took place over approximately a six month period in the fall and 
winter of 1979. The actual training was impiemented in three phases. Phase 
I consisted of ^. graduate level course, of f ered- during the Spring semester of 
1980. Phase II was implemented in the form of a three week intensive work- 
Shop in the summer of I98O. During this workshop, the Teache r Observation- 
Instrument ( TPS) was developed. Phase 1 1 1 , the last of the ALPBP training 
component j mm emen ted in Tucson, cons is ted .pf several stages; The first 
constituted a\preparat!on stage wherein the Ab^BP ^)roject 'staff identified 
salient issues\to bf considered for the ffel^l testing of the TPS, Following 
the preparation\ stage, a workshop was implemented in the spring of 1 981, to 
give teachers more formaV training in microethnographic/soGiolinguistic afield 
methods. This was undertaken with the specific purpose of enabling TUSD 
teachers^b field Vest the TPS . The next stage consisted -of the development . 
Qf criteria for anaVyzing th^ TPS field test results. The finalization of 
this process took pi lace in a two-day meeting in the summer of 1981 with a 
TUSD representative, the AUPBP Project Director, and 'ALPBP Research Associate. 



PhMips (t98t) provides a detailed description of Phase I. The actua;! " 
trarning proc^s^^s and^ outcomes from Phases 1 1 and I I I ^re ful ly .described 
in the body of the paper. The conclusion focuses on evaluat4ve information 
identifying limitations and significance of the ALPBP teacher training 
program, in Tucson. 

Theoretical and Methodological Approach 

Traditional lYr schools have used, a developmental model of acquisition of 
communicative skil ls based on white ifiiddle-cl ass Chi Idren's social ization 
experiences. This model assumes children come to school having the same 
basic experiences at home and in the community. It also assumes that cognitive 
and linguistic ski 1 1 development fol lows a rather fixed growth curve. which 
takes as the norm white middle-class chi Idren's developmental characteristics. 
These assumptions are reflected in standard mono! ingual curricuium objectives 
as well as in the Segmentation of knowledge by grade levisl . The model fails 
to recognize culturally different language socialization experiences of 
children from multilingual/multicultural backgrounds/ It lacks the necessary 
flexibinty eb build upon variabil ity In the acquisition of communicative 
skills by children of different cultural backgrounds, and to relate these - 
skills to the learningof new concepts at school . This lack of understanding 
and acceptance of culturally different language social izat Ion patterns of 
<;dmmunication may be a major factor contributing to the poor performance in 
school by language minority students (Note 1). 

■ ' f ' . ' ■ . 

' ^-Recognizing the, inadequacies of "this traditional model , an ethnographic/ 
sociolinguistfc approach to communicative proficiency and its assessment was 



adopted for use In the ALPBP teacher training ppogram. The approach entails 
both theoretical and methodological considerations about the nature oAchlldrenV. 
language acquisition, language use, and Its measurement. \ 

From a theoretical perspective, the concept of language proficiency \s 
•seen as embracing "the chi>d»s ful i range of social uses of 'language and non- 
verbal signals rather than encompassing uses associated with the transmlssio^ 
of literacY skills of reading and writing" (Phi Ups, p. 3). 



In order to operational ize this Interpretation of the language construct, 
Briere's (I979) integrative model of communicative proficiency was modified for \ 
use in the training process to include those factors which influence children's 
language development and language usev The model , 1 1 lustrated in Plgure 1 , 
consists of four bas^c components: ' linguistic competence and' linguistic per- 
formance ~ based on Chomsky's (1965) .understanding of language — and soc id- 
linguistic competence and soclolinguistic performance — based on Hymes (1972) 
interpretation of coinniunfcative comp^ftenca, \ 



nSiir* I. A SOCioUHGUlSTIC/llNaUiSTIC MODEL OF C OMMUM t CAT I VE PWf I CUNCY 

(Adapctd from Br J#r«, 1579) 



. > tlllCUISflC CWtTtWCI 
o( turn l^tMM^ 



Um of fitiUf 



50CltH.IKCyiSTIC COH^CrtHCf 
0/ l4ft^«M lit «o<Ul eo<iftji<, 



trngutstic competence refers to the intuitiye knowledge a native speaker 
hais about the ru I es of ,|iie_gram^ of h f s/he r 1 anguage(s ) ( i .e. phono 1 ogy , 
syntax, and the lexicon). This refers, for exaijiple, to the tacit knowledge a 
native English-speaking student has about when, and how to use both regular and 
irregular plurals, to make verb and noun agreements, or to understand the . 
sounds of the dialectal variations spoken- in various communities. 

Linguistic performance refers to the actual use the speaker makes of 
his/her linguistic competence using the "proper" grammar and vocabulary. 
These skills are evidenced in the ability to comprehend and speak as well as 
to read and write if 1 Iteracy skills have been introduced. 

Sociol inguistic'competence refers to the knowledge a native speaker has 
about the appropriate use of his/her language within different social environ- 
ments, i.e., the tacit "knowledge of what to say to whom, for what reason(s) ' 
and under what circumstance (s) . In the school setting, it refers t& the 
knowledge a- student has of the appropriate rules of interaction and interpre- 
tation when interacting with teachers, peers and other participants. 

Sociol ingu Tstic performance/refers to the actual coimiun icat i ve behaviors 
of a speaker which lead other members of a speech community to believe that 
he/she is communicating appropriately. For example, J n U.S. schools teachers 
often expect students 'to look them in the eye while being reprimanded or-when 
responding.^ in some cultures this is. considered inappropriate; thus, if a \ 
student does not provide a response appropriate to the culture, a teacher ^ 
unfamMiar with the child's cultural background might conclude 'that the student' 
IS drsrespectful or uncooperative. 



The ethnographic perspective requires the application of methodotogies 
which support observatJori of natural ly occurring interactions , participant 
observations and interviews as research tools for determining the nature of 
children's communicative proficiency. This is in contrast to experimentaT 
methodologies which focus on language interactions in contrived rather than- 
natural settings.,. By their very naturej experimental methodologies disregard 
children's natural language abil i ties. because they focus on knowledge of 
language sicl Ms which may I ie outside their social ization experiences. 

* . • - ■ * ■ * ' ■ .' • - * 

In an effort to develop observational criteria to be use4 in analyzing 
observations of chi Idren's natural ly occurring communicative interactions and 
relate these to communicative proficiency, ALPBR project staff reviewed . 
current theoretical and applied research on thenature of language and Its 
functional uses. Following is a brief summary from that review. 

. Hymes (1964) argues that knowledge of a language impl ies more than an 
innate and subconscious knowledge of thje rules of the language (Chomsky, 1965) . 
He suggests that language use with fn a Speech communrty consists of culturally 
influenced communication modes, which include systematic patterning of speech" 
governed by social rul4s. He proposes that an ethnography ^f speaking Is 
required to describe the patterns of language use In terms of their distribu- 
tion and function . He categorizes langliage in terms of basic' functions: - 
expressive, directive, and referential.- ' v v 

Halliday (1973) catigorizes language functions as instrumental, regula- 
tory,\interactional . heuristic, personal , imag i native and representational. 
The instrumental function, according to Hall i day , serves to manipulate' the 
environment, to cause certain events to happen, such as '*don't touch the stpve!'* 



etc. The r^gulatopy function serves in control ling events through the use of 
approval, disapproval, etc. The representational, function refers to the use 
of language to make stateinents, convey facts and knowledge, such as to explain, 
' or to. report, etc. The interactional function serves to ensure social main- 
tenance. This is exhibited in knowledge of slang, jargoii, jokes, politeness, 
and formal ity expectations. The personal function ajlows a speaker to express 
feelings and emotions. The heuristic function involves language used ;to 
acquire knowledge and to learn about the environment'. HeuPisticvfunctlons are 
often conveyed in the form of quest ions that will lead to answers. Children 
make good use of the heuristic functions in , their use of '^why questions. The" 
imaginative functions serve to creat imaginary systems of Ideas,: such as/ 
telling fairy tales, writing novels, creating poetry, etc. 

-Tough Cl97'») considers two basic functions of langgage: relational and 

ideational. The first one is used to "maintain the self" and the latter one 

' • ■ ' t. - - • 

is used to direct one's self to others' actions. ' 

As a result of ethnographic/sociol Inguistic observatiomj of young child-- 
ren's communicative interactions, Wi lkinSon tl'975l developed a 1 is-t of language 

fuiictions specifically related to them. Because-of their Importance in under- 
standing the /language use by school chi Idren,- the functions are 1 tsted below. 

' • . . ■ •« 

^ . ' •■ ■ ■ ■ '-'^ 

* FunctiQna of language 

Mho a« I? I, EatabUahing and maintaining aelf V 

. • 2 ,Ungu«c|a for anaiyzing t%it :< ' ^ - <♦ ^ « 

3 t-anguaga for axprasaing aaif . 
^ (for caietfrafcing dr daapairing, «tc. ) 

Who aca you? ' ^ esbabXiahing and maintaining relafciona 

* • = • 5 Co-gpWjpafcihg - 

.5 Cwpathiaing, underatanding tha othar 

7 Rdia piayinq, mimicry 

8 Cuiding, diracting th^ othar ^ 



Who/vm«t is 9 Giving in fQcmafcion 

. ti«/sh«/it? 10 R«ctlUnq •venti (pmit) . 

U OiMtibing pceMnt tvtnts 

12 Predicting futuci tvtnU ^ 

sfeitfwtnti qf inttntion - 
atattflitfitsor hypothftls . 
• • . what fiight h«pp«n - 

13 ,Analy«4ng> ciaMtfylfig 

14 Expliining, givlnqf f«wn foe 

. ,15 Exploring^ ««king qutafeiqna, btife In okhtr 

^•y« alao, by "sounding out** psopts 
16 f Ifct ing qn q*fn/qfchscs^ thoughts and 
& . ' 'fssilngs 

: * _ • * , \ - . . . ■ ' : \ •■ . 

(Wilkinson, 1974, pp. 5«^57) 



fn her study of teacher/childr^^ Interactions, Fillnxaro (1979) 

suggests. 5€^ral; f^^^ related to chUdren^s production and / 

comprehension. . Samples^f functions whfch she recognizes as^Jmportanr 4 urfng 
classroom Interactions are: td provide and el fcl t rnfprmatfon, to expraiil> 
to describe^ to cl'arrfy/ etc. " .* . * 



. / 
/ 



- addition to, research on. language functions, psychal inguist I c research 
by Cunmins viras felt to, be important "to the study of children's language use in 
school, Cummins- (1 980) suggests that there, are two Independent dimensions' of 
language proficiency: cognltive-academrc language skill?, which are related 
to 1 iteracy skri lis, and sociol fnguistic language ski I Is , wt;lch are related to 
.interpersonal communication skills. 

FiTlmore's (1976) research on the acquisition of Engl ish ski lis of 
five early elementary school children Indicates that both aspects' of language 
proficiency- suggested by Cummins have unique but interrelated char-acter I sties. • 
Both are essential for successful achievement and social interact ion In the 
classroom. Fillmore. notes that sociol inguist.ic aspects of language Are 
true J a I- to the acquisition and development of a second language in early 
elementary school children while cognitive-related functions of ten ^become 



n»re <:rittca1 for plder seqond-language learners because of the emphasis on 
academic perfoi-mance at higher grade levels, the imp Heat ion of Fillmore's 
work is that both sociol inguistic and cognitive-academic' language aspects are 
important/to meaningful and appropriate communication of second language 
■ learners*". ■ 

More recent research on language use in the classroom suggests that 
there are tvyo dichotomous language dimensions. One is more related to the 
service of cognition ~ academic-related language functions — and the other 
is related to the service of interpersonal social interactions — socio-- 
affective related language functions (Genesee, inpress). Successful communi- 
cation with other fiarticipants seems to be correlated to the degree to which 
the individual has mastered both dimensions of language use. 

The insights gained from the review of literature together with our 
experience as educators of language minority students provided the basis for" 
developing a framework for training teachers In language proficiency assessment 
issues ut I llzing ethnographlc/sociol Inguistic methodologies. 

implementation of the ALPBP Teacher Training Program; Process and Outcomes 

Phase I : Bi 1 Ingual Language Proficiency Assessment; An Ethnographic Approach . 
Phase I of the ALPBP teacher training program was implemented in- the spring 
of 19 80 by Dr. Susan Philips through an agreement with t>i6 University 
of Arizona School of Education Bll Ingual Program and the College of ^Liberal 
Arts Anthropology Department to co-sponsor a three credit (45 hr.) graduate 
course. The course was developed to meet the needs of part Ui pat ing teachers • 



It focused on three aspects of language proficiency as they relate to language 

minority students 

o Models of Language Proficiency; • 

o Language Profrciency in the Bi 1 ingual Classrpom; and 

b * Language Proficiency in- the 8i lingual Community. 

Through the course teachers were proyided with background In approaches 

to the assessment of language proficiency of language minority students. They 

w^re introduced to basic sociolingulstlc^^nd ethnographic concepts related to 

language assessment, and were guideci\ in the exploratioh of the nature of " 

children's language proficiency in both classroom and cprnmunity contexts. 

Sources of Information included lectures, readings, and discussions. A more 

detailed description of this aspect of the training component is found in 

Philips' paper, "An Ethnographic Approach to Language Prof iciency Assessment" 
(in press). 

Phase II: .Development of a Student Observation Instrument' to Determine the 
Communicative Proficiency of Uanguage Minority Students , the ttiedretical aWd 
methodo log I ca4 issues Introduced by Phi I ips fbrmed the basts for development 

of Phase 1 1 , which took the form of a three-week Intensive workshop. The goal 

<■ " - " - 

• ■ . ■' ■ . * ' ' . * . " 

of the workshop was to provide the participants with practical ethnographic/ 
. social inguistic f ield techniques which would enable them to participate in the 
development of a teacher observation Instrument. With the Instructors' guidance 
— Carmen Simlch, a sociol ingulst , and Robert Carrasco, an ethnographer ~ 
participants developed the TPS , 



The workshop included a rev law of the basic concepts of ethhograijhiQ 
• nwnitoring -in classroom- settings. Videotapes of interactions between ■ 
te^chftr/studentCs) and student (s) /student (s) in elementary bil ingual cla^s- . 
rooms Were used to aid in the development of teachers^ observation ski l is. 
The process was one of gy ided d i scovery where, through di scuss ion and bra i h- 
storming, teachers were made aware of the wide i^ange of communicatfve ski 1 Is 
studentsT iise with different participants in various c I ass rooin situations. ° 
The videotapes provided' a means for detai led discussion of ■-teacher/studentis) 
interact ions vs ^ student (s)/student(s) ihteractioq^s which fpcusfed on : 

o • language use, language choice, code-switching and their ; 
/relationship to communicative proficiency; 

Q Students* linguistic repertoi reis; and 

- . ■ ■ ^ ■ • • .• . . : ■ -f ■. 

. o sociol inguistic rules of interaction in the classroom. 

The discussions resulting from viewing the videotapes >/ere related to the^ 
teachers' practical experience. as ethnographers and participant observers. 
After viewing the tapes, the participants and works'hop leaders agreed that 
teachers were the most quaUfied to make val id emlc predictions about their own 
students '.comraun^i cat ive-^bil ities. Outside observers, it was concurred, would not 
general ly be aware of the specif ic rules of interaction implicitly or expticiti 
agreed upon ty participants in classroom settings. ' 

Early in the workshop, teachers^ were asked, to list students' behavfors 
that, m their opinion, correlated with English proficiency. The purpose of * 

the activity was to identify participants* uriderstanding of communicative 

. ■ ,.' ■ ■ -• • ■ . ■ '■ ■ * - ' ' ' / • • • ■ 

profixiency. Response? from this informal survey , "summariiied in Table I, were. 

analyzed^ and grouped into four categories of behavriors. These are: 



linguistic behaviors related to grammatical, morphological,. 
>, and syntactic skills -In oral speech, as well as literacy 
skills; .. , 

•thnographic/sociol inguistic behaviors related to language 
(lie. considering setting, parti clp^ants, nonverbal behaviors, * . 
goals of interaction, language(s) used, by students; 

student background factors reilated .to language of the home, 
Iangu4ge(s) exposure, "yea r*s of schooling, etc.; and 

psychological factors related to self-concept and language(s) 
used in emotional interactions. 

Sixty-five percent of the total number of behaviors Identified were linguistiCi 

Seventeen percent fell within the ethrtbgraphic/sociol inguistic category, 

tiMlve percent were stuiient baickground factors and six percent were psycho- 

logical, factors.. The most frequently cited linguistic behaviors focused on 

ability to.explain, amount of code-switching during discourse^ cbntributipn 

tq discussion anc^' initiating conversation. Word order, command of synt^ix, 

and.vocabulary as well as the ability to complete writing assignments were 

clted'as major indicators- of "good" wrl ting abi 1 ity. Listening factors se- 

fected were "good" receptive abi I i ty and understanding verbal cues . .Only one 

reading skill, the ability to read at grade level, was named. 

Among the most often listed ethnographlc/sociol inguistic behaviors were: 
the languageCs) students use during play situations, the use of nonverbal 
behaviors, "language fluency,'^gjnd ability to in i tiate conversation with ^ 
different participants in dis^nct cqntextual settings. Background informa- 
tion factors cited were: language of the home, number of years of schooling, 
information in students' cumulati.ve fi le, and ethnic background; Language use 
in the home was the one most often mentioned.' * The psycho log ica If actors 
designated were: students* shyness or self-conscfousness, and language C$) 
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used during enxational intera<:tions^ short, \esul ts from the' survey Indi- 



cated '|hat.: 



i. 



■ o teaqhers' criteria, forjudging language p-roficiency' is 
« generally based on a consideration of linguistic factors 
"'with a particular emphasis on oral language skills; 

/ o ^ few teachers include nonverbal language in thej*?- criteria 
of communicative performance? and; 

o few teachers consider/ in their cri'teria, students.' ^. . " 
. appropriate usie of language in. terms of contextual and ' 
psychological factoids aftecting commun i tat ion. ' 

The, communicative prof iciency model 4|lapted from Briere (1979^ see Figure 
was discussed with teachers, and related to results from the teacher survey. 

The purpose In utilizing this model was to make participants aware that • 

. " ■«•. ' 

language use requires speaicers/tisteners to possess more than the knowledge 
of the graiiimar of a Janguage;.and that social ihguistic aspects of 'language • 
shdyld be takei/ into account- when assessing communicative proficiency. After 
relating the mbdel to" the- results of the survey, participants arrived at the 
conclusion that there was a need to consider the communicative proficiency of 
their students in terttis of both linguistfic and sociollnguist ic skills. 

■* The review of basic ethnographic concepts} discussion of the results from 
the teachers' survey of communicative proficiency factors, and a modified, 
sociolingulstlc model df communicative proficiency (Briere, 1979) provided 
the- foundation for the Inductive process used to develop the TOS. • • 

The major questions raised during i ts' conceptual izatioa and .development 

were: • ■ i . , , . ■ " ' 

\- . •■ ' ■ * ■ , ' - 

■ ■ • ' — ' . ■ 

o ^ What kinds of functional language ski 1 1 s does the 

• ' language minority stfudent bring to school? " 

Q_ In 'which languageCsy*, social contexts, and for what 

purposes does the stusient communlxate best? , 



o in which langua^e(s) do«s the student have the w(d 
contextual range of communicative abilities? 

' What kinds of communicative' ski lis does the student 

need to mastef in order to parjticipatc appropriately 
as a member ° of 'thp school speech communi ty? . 

Impohant in the process of developing the TOS was the selection of 
contex^tual settings in which to observe students' communicative interactions y 
thr* language(s) of instruction, directness or indirectness of "teacher talk," 
and classroom organizat ion (teacher-centered vs. student-centered) . ' The • 
language characteristics and linguistic background of the student were also 
considered consequential for the planning of the TPS.. Ethnographic. socTo- 
linguistic and educational variables considered significant were:- background 
of parents, number of sib I ings at home, age,; language use at home and in the " 

communfty, ethnohistorical and ethnof inguistijc information. 

\ ■ . • . ■ ■ ' . . 

The recognition that students have varied repertoires of functional 
language use in different situations and with" different participants, motivated 
the selection of some components of speech events suggested by Hymes (1972) as 
the basis for developing the TPS. Table 1 describes those components used 
during the initial stage of development* They were: setting^ participants, 
channel of conwunication, languages. used and discourse characteri sties ^ 

. .' ■ .V ■ • TA81E 2 ; •* - ^ 

COHMNHNTS of instructional events to 8E comsioereo 
IN THE PEVELOPMENT OF THE TEACHER MSERVAT I ON /SYS f EH 



Instructional Ttachcr/Scudtntfs) * speaking English* coherence 

(fon^l) StudefLt/StudentCs) nstenm? Spanish complexity, 

" " treading adequacy or vocabuUiry 

Nort-irtStructlcn^l writing code-switch I hg 

settings 



Ideally, an ethnographic approach to language proficiency assessment 
consists of observing a student in ^he commurti-ty, home and school contexts. 
Howtver, because of 'th* Jmpracticabtllty of doing so in all three domains, 
it was decided to obtain community and home information through student 
interviews and other available school records, and to only observe students 
in the school setting.^ \ 

The advantages and disadvantages of using the categories of setting, 
partfcIpantCs) , socfol inguistrc behaviors, etc. , was a critical issue of ' 
discussion in the development of the TPS. After considering the range of 
speech events that usual ly occur in a school day, three representative 
situtftfons and sociail contexts were chosen. ' fn order to assist dfaservers in 
the description of students' communicative behayi or in the different inter- 
actronal contexts ,' basic questions were developed. The qtjestions provide a 
guide to the observer in describing a student's range of coiwnunicative sklTls 
The questions and interactions are described in Table 3. 
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aaSERVATIOM QUESTIONS IN SOCIAL CONTEXTS 


V Social Contexts: 


Adult Oirtcttd P«tr Group Non-inscryctional - Qthtr 
Instructional Instruccfonal 


Qutstions CO bt 
answ«r«d during 


K What Ianguaga($) and/or nonverbal behavior are usid by the sCud^^nt 
CO cbmnuntcate? 


obstrvattons: 


When the child does not bommuhlcate verbally, what evidence do you 
se« that Indicates understanding? Oescrlbe the behavior observed. 


N . ^ 


When th« student does not seem to. understand, what does she/he do 
to clarify the situation? Describe the communicative behavior 
observed. # 

•< ■ • 

3» Does the student Follow the implicit and explicit rules of 
communication of the social context you are observing? 



.The fJftld test vers Ion- of the TOS.( Appendix A) has three components: 
Section I: Background information 
Section II: Teacher Observation Data Sheet 
■ Section HI; Description of Observation Data 

Section I consists of a three part questionnaire: -student information, optimal 
student information, and teacher information V The first part includes questions. ' 
regarding basic information. about a student's name, age,,sex, birthdate and 
language' usage. The second part contains questions about previous school Ing 
•experiences and language(s) used in the home. The third part includes questions 
about the teacher's language baclcg round. Sect i on M includes four social 
contexts used to describe students' communicative behaviors. Three basic 

^' - "■ • ■ . -a . . ■ 

; ■ -I ■ .- . . ■ - ■ ■, • • , 

questions guide the observer to focus on specif ic'comnun i cat ive behavior. 
Section 111 consists of two parts. In part one, the teacher summarizes, the 
observed student's communicative behavior. In part two, extra Unguis tic factors 
that may affect students' communicative ability (e.g. , physical , emoiionalj 
and/or social) are described. 

A pre 1 imi nary usage Manual for use with the TOS was also developed. It 
consists of foui; sections: - 
o Introduction 

o Rationale: description of the ethnographic/sociolinguistic 

theories and methodologies underlying the develop- 
ment of the TOS . / 



o How to use the TOS 
J3_l_ Glossary of terms 



The TOS Usage Manual has not been revised since it was origirtally developed 
during the second ALPBP teacher training workshop. ' 



The introduction summarizes the pui*pose of the JOS. The rationale , 
provides the theoretical and methodological approaches which serve as a 
framework for an interpretation of students' communicative proficiency. 
The third sictton describes how to use the TOS. The glossary of terms defines 
ttrmfnoldgy used in the TOS and in the TPS Usage Manual. 

Phase 1 1 1 ; Toward a Vai idation of the TPS, f t was recognized that' before the 

W could be validatedvand be of practi^l use to teachers. It was necessary 
to determine whether: 

o . the selected TOS. interactional contexts sample. valid 
presentations of students V classroom interactions; 

, . o the^ three questions for each interactional context 
solicit from ttie ^observer an accurate description of 
the observed students' functipnar language abilities;'' 

o behaviors descr I b(pd by teachers focus on a description 
- of functional language use; ^ 

o I t^ r$ possrble to identify, students* functional 

abilities through observation of selected classroom 
even ts ; and ' . ' 

■ o it is possible to develop a representative number 

of comrnunicative performance indicators based on • 
identff icatiqn of functional language abilities- V 

■ *• . >f ' a ■ - . * . . . 

In order to clarify these js„sues* and in preparation for field testing of 
the TOS_, participants were further trained in the use of microethnographic/ 
sociolinguistic field methods to i dent ifyVhow children use language for 
functional purposes. The workshop was organized by Charlene Rivera and Carmen 
Simich. It was expected that participants would gain a better understanding 
of what students need to know in order to accdmpl ish communicative tasks 
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'during cU^room interactions, with the goal of relating this understanding 
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a reviW of basic concepts of language proficiency and 
language proficiency assessment; 

a reviewXof the anthropological orientation of "doing 
ethnography" in classroom settings; 



a revicw\ot\ the nature and intent of the Toj; and 

a format intr-oduct ion to functional uses of language 
m the schoor^ home, and community settings and. their 

relationship t9 the teacher observation tasks out 1 ined 
in the TOS, \ ^ * 



: '^^'^ field testing of the TOS was incorporated into the two-day session. 

'^*''« P«'''«**^r«*^"iVned to different ^s^ 
U from kindergarten to ninth grade in chosen instructional, events. Each teacher 

n. . recorded his/her observations individual iy. The half day observations were 

recorded in terms^of functional language used. by the observed students 
jl and other participants, e.g., teacher, peers, etc. Two teachers were assigned 

to observe the same student'in order to compare observations and increase 
observer rel lab i,l i ty . Fol 1 owi ng the observat ions , i nstructors and particrpants 
|- discussed the problems and rewards of the experience. Based on their insights 

into the process, small groups reviewed the experience, bra instormed , and 

1^ <*'scussed possible '•indicators'' of communicative proficiency. "Participants 

(- also made recommendations for changes in TOS content and format. 

L ■ . ' ' • ' ~ . ■:■ ■ \ : ■ 

Efforts in the Development and Va I i da t ion of the TPS . In 1 ate May , .198I j 
b a meet^ing was held between ALP BP project personnel and a representative frdm . 

Tucson Unified School District. The purpose of the meeting was to develop 
criteria for analyzing the T0£ field test data/. The criteria agreed upon was: 



whether the observer answered the three questions for 
each of the four social contexts posed in the TOS (see 
Table 3); 

whether the observer provided a complete and accurate 
description of the social contexts observed; 

whether the observer described a student's behavior 
in terms of functional^ language use; and 

whether the observer's summary of the observation ' 
recommendations for student placement were represen- 
tative of their description of the student's functional 
language abilities. 



- Because the TOS was at the field test stage, the ALPBP staff were con* 
cerned that TUSD would attempft to identify "indicators" of conrniun] cat ive 
proficiency based only on the field test. 'However, after reviewing the field 
test results, the concensus of the ALPBP staff and the TUSD representative 
was that, at most, the data could provide a sample list of communicative 
functions related to language proficiency identified at the time of the field 
test. Most importantly, it was concurred that the data could not compensate 

for an ethnographic/socionnguistic study of natural language use In elemen- 
' ' ' - • .■ 

tary classrooms to investigate what "ways of speaking" (Hymes, 1972, 1974) 
or functional uses of language that are available to participants In school 
settings. Based on Identification of reliable and valid indicators, it would 
then be possible to determine what sociol ingui sti c skills students need In 
order to be considered proficient communicators. Once reliable and val Id 
indicators are identified, it would then be possible to formally val idate-^he^ 
TOS or any other similar instrument. 
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Conclusion 

In this concluding s«ctfon, the Uml tat Tons and significance of the ALPBP 
te^er training program in Tucson are described. The purppse Is to provide 
evaluative information regarding the ethnographlc/sociolingulstic approach to 
language proflGrency assessment, 

Uimitatlons of an Ethnographic/Socionngulstlc Approach to Language Proficiency 
Assessment - The 1 imitations of the approach were found to be related to its 
Implementation In actual classroom situations rather than to its conceptual 
franrework (Philfps, in press). The nxjst significant determinants of successful 
implementation In Tucson were found to be: 

o the working relationship between teachers and administrators; 

o the time required td become familiar with the ethnographic/ 

sociol inguistic orientation to language proficiency V ■ 
assessment; 

o the educational background of teachers; and ^ 

o . the characteristics of the ethhographfc/sociol inguist ic 
approach. 

The Worklng.Relationsl-iip Among TUSO Educators , Cooperation of educators 
to participate in any training program is highly related to the working rela- 
tionship between teachers aftd administrators. In the case of TUSD, some 
tension was Evidenced between teachers and administrators because of inadequate 
communication between the two. <}n the one hand, teachers sometimes felt 
impotent and frustrated because they were not always sufficiently informed 
about the admin istratj ye details which affected them. On the other hand, 
it wa^ evident that internal school district Changes and pressures were 
reflected in the administrators* relationship with the teachers, and for thts 
reason^ administrative details were not always communicated to teachers. 



Despite this tensJon, the gradual involvement afid acceptance of the ideas . 
^ presented during the ALPBP training sessions became a rtuDtiva ting force for r 
both teachers and administrators to cooperate fully. 

The Time Factor , Tlme'^ to assimi late^ b^^^^ concepts and to 

become experfenced In their application was found to .be a problematic aspect 
in the training of the Tucson teachers* .The time alloted for training was 
negotiated by ALPBP staff with the TUSD 1 iaisons, and was Uml ted primarily 1 
by district constraints. < 

Al though each of the three phases of the training program was carefal ly 
planned, difficulties arose in coordinating, sufficient leave time for, teachers 
to attend extended training sessions Short intermittent sessions were riot 

generally possible because the major consultants were not in the Tucson area; 

' ■ > 

The participating teacheirs found that the short intense training sessions did 

not always allow sufficient time to absorb and understand the new theoretical 
concepts being introduced* One teacher summarized the feeling by Indicating 
that -the "time Cwas) too rushed.** She" felt '^overwhelmed with information." 
Other teachers suggested that more time should have been given for additional 
practice and demonstration of obs:ervationa] techniques, ideally, participants 
concurred, training sessions should be distributed throughout the scKo.0 1 
year to allow for clarification of theoretl.cal concepts and thelV application 
in the classroom. 

. ■ • ' •' * 

Teacher Educat ibna I Background . Teachers do not generally have a back- 
ground in child language development or second language acquisition issues. 
They are not' familiar with communiqative, patterns of interaction of multicultural/ 
multilingual student populations; nor are they familiar wi'th the rationale » 



for assess ijig language proficiency. In Tucson, ft was found that teachers 
highly correlate Ihglish language prof icfeijcy with knowledge of discrete 
grammat i cal /phenol og I ca M terns . The part i c ipan t survey (Tab le 1 ) con if i rmed 
that,biringyal educators were not consciouS:ly aware of how soclocultural V 
variables^jnfl'uence; the manner in which raorpholpgica.1 , phonological and 
lexical items are integrated into cohesive discourse, Teachers-i concerns 
regarding the assessment of students' language proficiency were, in general, 
focused on ease of test admi>istratioir,and interpretation of teSt results f 
rather than with the. nature and scope of ,'children's language and its . 
vali'd measurement. A general recommendation from the instructors who worked 
with the teachers was that courses in linguistics, including child language 
development, second language acqaisitlon, and language proficiency assessment 
be integrated into undergraduate programs so" that the new generation of 
teachers is prepared to deal with the complexities of assessing the language 
proficiency of language minority students. 

Characteristics^ of Che Ethnographic/Soclol inguistic Approach. The 
approach" requires systematic obseryation, by a participant Observer, of students' 
language use fn 'naturally occurring communicative situations in different domains 
community, home and school, -^hie role of participant observer has two dimensions: 
that of a detached, oTjject I ve observer, and that of* an active participant. As 
such, it requires a person to observe and, at the sa/ne time, 'participate in 
cdiwnunicati Ve interactions from a detached yet focused perspective/ 

rn attempting.touttl 126 this approach jn the TOS Tt was found that this 
dual Vole can, and generally is, problematic because 1 1 requires that the 
teacher concentrate attention on the cornmunicative behaviors of one student 
while simultaneously maintaining the teacher role providing meaningful learning 



activities for all students in the classroom. However, because of'the nature 
of the T0£, which favors observations by participants' who already have an 
"Insiders" knowledge of social rules of language use in each individual class- 
room., It was decided' to use this approach. 

Significance of the E thnographic/SQciolinauistic Approach to Training Teachers 

in Language Prof icien cy Assessment Issues . Despite the 1 iml tat ions described 

above, there wer# several significant outcomes from the AUPBP teacher training 

approach to language prof ici^ency assessment. The major outcomes we j*e; 

o teachers' awareness of the fiol istic nature of language ; 

o changes In teachers' philosophy of education, as reflected ' ' • 
in their self-assessment of classroom organization and 
management practices; and - ^ . , 

■ / . ... : ' . .■ ^ . ■ ■ ; ;. • ^ ' • • 

o the development of an ethnograph I c/sd^ 

language proficiency instrument, the "ras.^ 

" - . ■ ■ ■ ^ - . ■ / ' ^. ■ ^ ■ ■ ' - • 

" ' ' ■ • ■ ■ ■ • * ... ■ ' , ■. " " 

Teachers ', Awareness»of the Ho Irstic. Nature of Language-. The holistic 
orientation to the nature of language and language laroficiency assessment is ' 
an important aspect of the ^thnograph'ic/soclol inguistic approach to language 
proficiency assessment. Within this non-traditional approach, language 
proficiency is defined as knowledge of the grammar of a language together 
with knowledge of the rules of language use.. In addition to linguistic variables, 
sociocultural and soci-ol inguistic variables, such as sett.ing, participant(s) , 
topicCsy of interaction, "lartguagejs) used at home, school and community are 
acknowledged. This approach is in contrast to the more trad i tional one where 
the major criterion for evaluatingjanguage proficiency Is knowledge of,: ^ ' 
specific grammatical and phonological items without consideratron of the •• 
rules of interaction andother sociocuitur^l and spciollnguistic variables 
that affect comrriun feat ion^. . > 



the obsefvations of children's cd»nmunrcatlve interactions anV class ' 

discussions provided the opportunity for tMPhers to become more conscious Of 

■ ■ . - ■ ■ '^^ ' . ■ ■ ■ - ■ ' ■ * .' ■ 

the Influence of social Inguistic factors J» children's lancjuage use. . Awareness 

■ " ■ ■ ■ ' ' ■ ■ ' ■ ' ' / ^ ' ' ■ . ■ ' \' 

of the holi Stic nature of language mtivated participants to feanalYze their 

understanding of language use and its role in classroom Cbmrouni cat ion and 
learning. One teacher summarized,"! gained additional insight' into communi- 
cation as a whole package." Another teacher said, "I now understand communi- 
cation Is not only verbal." One teacher indlca'ted, "(I am now) more obseryant 
o'f the manner in which chi Idren communicate. .. I have learned %o focus on the ' 
function of communicative behaviors. ..to hot only listen to what is or is not 
said but to pay more attention to how the message is communicated." 

Changes .In Ph i 1 osophy of Educa t i oh . the understanding and acc^eptance of 
the ethnographic/sociol inguistic approach and subsequent changes in phijosbphy 
of. education were evidenced by comments and diseuss ions between participating 
teachers and VHistructors^. Through the training, teachers became more conscious 
of the need to/expose children to different situations in orderly to promote / 
motivation and learning through a variety of communicative interactions with 
different participants in various sociarcontexts . This understanding 
influenced some teachers to modify their views regarding classroom organizatrorr 
and management. One teacher indicated, now) organi5:e physieaMy in order 
to allow for rnqre freedom^ of interaction." Anot^her teacher stated, V'l feel^ an 
increased serrsitivity to the perceptions irhildren haive of their environment, 
especially of their school environment/ 1 feel more acutely aware of' th* 
vario^us levels ^of activity occurring in the classroom and school ." 



■ . ■ ■ . . ■ ■]: ■ • ■ ■ 

The .Development of the TPS . The de>ie1opmertt of a non-tradl t fonlH 'instVu- 
ment, the TPS, was another significant 6i|tcome of the AtPBP training. The TPS 
is the first instrument which attempts toi relate focused teacher observations 
df students* functional language usd in Cjtassroom settings and. communicative:^ 
proficiency/ The development of the TOS iis important because it has the 
potential of providtng teachers with an instrumeri't which acknowledges the 
wide range of communicative abilities of language minority students. Altlndugh 
the TPS itself i-s not yet val idated and possibly never wil l be," it represents 
iSn important innovation in. language prGfidiency assessment practice which has 
far reaching implications for educators servicing language minority students. 
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Background and Alma 

. ' ■ • - • ■* ■ ^ • 

Tha purpoaa of this report is to describe and evaluate a five^ 

week course on^ language proficiency and minority students taught by Jim 
Cuimnins and Lily Wong Fillmore with the assistance of Kip Anderso|i as ' 
part of the 1981 Berkeley Summer Progriam for Teachers^* The course was 
developed within the context of the Language Assessment 'Pro j ect awarded to 
InterAmerica by the National Institute of Education in October , 1979 • In , 
addition td*the funding of research in the area of language proficiency 
assesslnent, the project sought to develop a teacher training program 
which would provide educators with an understanding of language assess- 
ment issues. / 

* ■ ■ •" • 

The first phase of the teacher training component was implemented 
in Tucson, Arizona by means of^a course taught by Susan Phillips of the 
University of Arizona.. This course emphasized the potential contributions 
of ethnographic approaches to language proficiency assessment \ 

d * ' ■ ■ 

The present course was entitled "Speaking of English: Teaching the 

Language l^prity Student", In developing the course we took the position 
that the issue of language proficiency assessment could be discussed ade- 
quately oiay within ^he context c^f the language minority student's total 
educational^ situaticJn. Thus, the first two weeks of the. course were 
directed towards helping students understand ^the broader thebretle.al 
issues iaivoUved in the education of language minority students (e.g. the 
rationale for bilingual education, the nature of language proficiency, 
how language ±k learned etcO; the practical impli'Cations of the research 
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findings and theoretical cbnstructs were discussed in the third week, 
viiile in the fourth week approaches to language proficiency assessment 
were Integrated into this context. In the fifth week students .presented 
inservice workshops ^ch they ha,d developed on the basis of the course 
.content." The course outline is presented in Appendix ^. ^ 

Characteristics of Students ^ 

Of the 22 students in the course, 11 taught at the elementary 
level, 8. at the secondary level, and .3 taught adults. The: majority were 
either ESL or regular classroom teachers; only three weriB bilingual 
teachers. The three major categories of reasons for participating in 
the course weye: 1. to learn more about the process of second language 
(L2) acquisition;, 2. to gain more knowledge about appropriate ways of 
language proficiency assessment; and 3. t^ find out ways of helping. ... 
regular teachers cope With ESL. students in their classes. . 

About half the students taught in the Oakland School District 
and several^expressed dissatisfaction with the BSM which is used for . 
assessing Limited English prof iciency i^ .Oakland . For example, one 
teacher reported that "in my district many ESt teachers deplore, the 
BSM test as a viable evaluation of language proficiency"..- . 

♦ 

Students' Initial Views oif (a) Language Pfofici enov and (b) Educational 
Practice and Policy for LEP Students . , ^ 

Students were asked on the first day of class for their .under- 
Standing df the' :tgrm "language prof icency" and for theiE views on appro- 
priate edticational policy towards LEP students . The purpose of this 
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vas twofold: first to provide the instructors with Information on what 
background and aaaumptions students were bringing to the course, and 
second, to provide "pretest" information against vrtiich growth in undar- 
Standing the issues could be assessed. ^ The questionnaire completed by 
Students ia presented in Appendix ^ } 

CaL Language Proficiency 

Most students stressed the fact that language proficiency 
involved the ability to communicate adequately. with native speakers. 

of a language* The following example is typical: ^ 

"The individual would be able to ' communicate clearly 
(to make himself understood), understand what is 
communicated to him, read and understand the written 
language, and go about his everyday life (job) comfort- 
ably." ' 

„ Several students made the , point that there are many different 

V levels of language prof iciency and that the "adequacy" of an individual's 

proficiency is not an absolute but must be considered in terms of the 

linguistic ^demands of her/his situation and aspirations. One student 

^anticipated some of the points that would be dealt with in the first two 

weeks of the course by pointing out that:^^ 

"Communicative skill requires learners -to know the . 
r functions of the language in addition_j:o grammatical 

knowledge of the language, while reading and writing ^ ^ 
skills require more explicit knowledge of the langtiage." 

^ Cb) Educational Pj?aetice and Policy for LEP Students - - 

s' f: V ■ ■ , , . - . . / ■ 

. ' Not surprisingly, students' responses to ^ this question tended to 

^ * . reflect thei* own teaching situations. General principles of appropriate 



tMching were stressed rather than program methodologies (e.g. ESL vs; 
Bilingual etc,^). Among the principles mentioned were; ^ the Importance " 
of promoting students* motivation to learn English and their confidence 
ijx their ability to do so; - reinforcing students' self-esteem and ensuring 
that programi contexUt is culturally appropriate; - diagnosing individual 
student needs; - involving parents; introducing writing as. an integral 
part of an ESL program. Some students stressed the Importance of bilingual 
programs while others argued fqr "strictly adhering to the teaching of 
acquiring skill in English"; however, most students did not consider the 
issue in "either /or" terms. The following is a good example of this 
integrative approach: 

"The most important principles around which education for 
LES/NES students should be developed are; the same as those 
for all children: children will learn when they are pro- 
vided with experiences* and activities at an academic level 
which guarantee.:, success and in a language which they under- 
stand, and when they are provided with a significant other 
(teacher, par ^t, other child) , who ^Irepdy possesses the 
ski],l being "taught", with whom to interact during the exper- 
ience. This holds * true for language as well as reading, 
writing, mathematics or any skill worth learnings" 

Course Description 

The general format of the course and ;reading and assignment proce- 
dures are described in the t:ourse ^outline (Appendix 1) and will not be 
repeated here. The assignments were ^iesigned not only to help students 
articulate the issues and relat^ them to* their previous experience but 
also to provide feedback to the instructors about issues that required . 

■ , . I 

mSte treatment. Assigniaents were discontinued after the third week both 

tt . . " . ■ . . . 

because students were working intensively on their group inservice -projects 



«nd alao because the Instructors were having' difficulty Ia keep iiig^^^i^^ 
date with the assignments. However, the assigmients appear to have been 
especially valuable during the first twoV weeks in helping students relate 
to their own experience the considerable axnount of theoretical reiddings ' 
.they were required to do. An ^cample of the critical reflection process 
that the assignment procedure encouraged is given in Appendix 3. 

Students' reactions to the heavy theoretical emphasis during the 
first two . weeks was surprisingly positive. As is evident from the course 

outline, a broad range of compieic issues w^as covered In a short period of 

f • ' - ■ . ' ■ 

time and students were required to carry a considerable reading and assign-* 
ment load. Bowever, it was clear from the asslgitments. and cla^iitQOia discus'-' 
slon that a^arge majoriify of students ., saw the theoretical 'issues as rele*- 
vant to their . practical classroom concerns , with the result that they com- 
mitted themselves Intellectually to grappling with the ideas ♦ 

During the first two weeks considerable discussion took place about 
the merits oj otherwise of bilingtial education in the United States; This 
interaction resulted in modification of the views both of those who Were 
unreservedly negative as well as* those who were unreservedly positive. The 
former appeared ready, for the most part, to acknowledge that some forms 
of bilingual instrui^t ion were pedagogically worthwhile in certain circum-* 
stances, while the latter gaii^ied an appreciation of the real difficulties 
pf implementing viabli£ bilingual programs in some urban situations and 

the conflicts associated with billn^al education within schools and dis-* 

> - ft - - ' 

■ -* • . . ■ ' . 

. I. ' • ■ • . • . ' ■- • ■ , ■ . ■ 

tricts. Jay Kleckner,- Principal of a multi-ethnic Oakland school, gave a 



guest lecture which contributed substantially to our awareness of these 
problems. " ^ 

In the tnird week the practical classroom iinpllcatlons of the 
theoretical constructs were considered^ Ways* o£ structuring L2 input 
so that it would be coBxprehenslble to language minority students were 
examined in light of the processes of language acqulsl^on and academic 
developmeixt identified in the first two weeks of the course • Ve attemptred 
to show how language assessment should and could be an integral part of 
any approach to teaching language minority students* The monitoring of 
students* output by the teacher should serve as feedback whereby s/he- can 
assess the success of past instruction and structure future L2 input in 
such a way that students can make sense pf lt» 

^JEhls theme was cont4.nued in the fourth week in which language pro-* 
ficiency assessment was explicitly examined. It did not take long to 
establish that. most cozmnerclal tests developed to assess proficiency among 
LEF students were of limited use to the classroom teacher. Thus, we con** 
centrated 'Oir ways in which teachers could become sensitive to manlfesta^ 

t ions, of students* proficiency in the classroom. SusSn Fhlllips* account 

. " ' ■ ' f > , ■■ . 

of the ways in which an ethnographic orientation could contrijbute to this 

«% ' ■ ■ ■ , • . ■ 

process was extremely valuable in complementing the more psycholingulstic 
orientation of the Instructors. The taxonomy of classroom oral language 
(Appendix 4) developed by Lily Wong Fillmore served as a basis for showing 
how teachers covild develop Izifomaal assessment procedures for individual 
students in theit classes. / / * 



The same orieiitatloa was emphasized in our earlier (second an<l * 

. ' ■• • ■ ."• \ ■ . • " • • ; ;■ " : 

third week) discussions of assessment of written Iot The integration 

. ■ ■ ■ • • \ . - . " t ' 

of assessment with actual pedagogical procedures (evg. using cloze a^ both . 

a teaching and assessment tobl, ndLscue analysis of oral reading etc.) Vas 

considered much more useful than contrived test encounters Ce»g. standard- ^ 

ized tests) fot the classroom teacher Thus, in assessing both writteA 

and oral language we stressed. using students' .nittiralistfc language output 

as feedback by means of which teachers could app|:oprietely^ modify their 

subsequent instructional input* *' \ . ' 

In the final week students presented their "insenrice packets" to . 
the class. They had worked on ^hese in small groups throughout the .previous 
four weeks and the results showed that there is no shortage of creat:ivl,ty 
and ingenuity fflttong classroom teachers: During^the week we made out own 
individual language experience books, role-played a sceptical school faculty 
being inserviced^ analysed a videotape of an ESL class, and even noacle iglops 
out of parachutesCDf all in the name of la^uage proficiency development 
and assessment* . , ' 

Some examples of the procedures teachers produced for language pro- 

• . - . " - ' ■ /f - - ' ' 

ficiency assessment are. shown in. Appendix 5. These were intended! not as /" 
"final products" but rather vtb provide inservice participants with examples 
of the kinds of procedures that might be developed*. ^ ' 

VPost-test" Views /' ^ ^ ^ % • 

On the last day" of dais's students were asked to again answer the 
two questions they answered at the 'beginning of the course (Appendix ,2) . . 

. / ■ ■. ' ' ' : . ' : - 

■ ^...^..^ ■■ 
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(f^ Language Proficiency 

Host responses again emphia^ized the centra], role of adequate 

. conmiunicative skills in any conceptualization of language prof icieincy. 

However 9 a cotisiderably greater proportion of students incorporated 

notions of situational appropriacy and coxamunicati^e nfeeds of speakers 

a;iid listeners in the criterial (pensions of p ' 

•V clear shift. towards viewing language relative rather^ than : 

absolute terms. For example: * t / - 

•The most central attribute of lan^aage proficien^&y^ 
^ theUj Is the needs of the speakerV* .'Anyone who is h#adi- 
* capped in achieving Ms/her goals iby a lack of cpnti^rol 

over a language is not prbficient. . 

"We never are *Vroficient" in a language. We are con-*^ 
stantly esqgianding,^ refining and improving our usage. 
Children do this same thing in the early stages of their 
. acquisition." ^ y 

"^Language proficiency' is acheived when a speaker has 
reached a level of communicatiYe competence such that com- 
prehension, and prodiaction. fall in the quadrant of being", 
' cognitively . undemanding even in context-reduced sittzationis 

* - * /(refer to Cummins' graph) . A spelKer may be fully pro- 
ficient in. one area of language in a given context and 
^ /: yet be inadequate in prof iciency in another contexts" 

Several students showed a greater appreciation of the complexities 

■ ■ ' ■ .' • • ■ ' '\ ■ ' ■ ' , ■ . ^ . 

of the construct 6f language* t)rof icency: for example: 

"After all the discussion these past weeks on language 
. proficiency, I find the term §ven more difficult to definfel 

"I've come to view language proficiency as kind of a ghost, 
. wr^thout any real form or definition. Througho^it the course 
we've discussed so many aspect's of proficiency ^that I find 
it hard to define it without a specific context, i.e. high 
\ schoql," adult school, survival on the job. My ideal of .- 

proficiency is that the L2 student will be able to express 
. / more tKan functional phrasesXe.g. "t would like to cash a 

check", "How do you do, this .or that?", ete.) but to biB able 



to express feelings of discuss abstract or "context-reduced" ' 
Ideas, using the appropriate idiom -^or dialer 
phrasesr that ixe necessary for "competent conahiinicatipn" 
(another ghosts. ») ^ : \ 

Educational Practice and Policy for LEP Students <^ , ^ 

^ . • ■ ■ ' " . ■ ' ■ ' \ 0 \ , ■ 

The influence of the Interaction among students as well as oiE the 
lectures and readings *ls yery evident . In responses to this question. !niere 

was a major shift towards emphasizing meaningful communication in the class-r^ 

• ■ i> • . ■ ■ 

■. - * ■ ■' •■ ■ ■ ■ , • ■ ,' : • ' : ••■ 

room and being sensitive to and making instructional^ use of students* liack- ;^ 

ground experience. Several stiidents also j^entldhed the importance^ of. using 

"language experience" prbcfedures not just for teaching initial rfeadlng but ?fot: 

4 - ■ _ ■; ■■■ ■ ■■ :;" ■'"V^"" ■ ■ 

dweloplng language skills in generals There was a much greater degtee of « 

Specificity in "post-test" recommendations than in the pretest where the v 
principles tended to be somewhat vagiie (eg. "encourage self *-es teem", "moti- 
vate syiudents" etc.). ^ > ' 

■ • - - '- ' . .. ,. '^Oi, 

Among several students who were initially doubtful about the merits 

- ' " ' ' y "^'^ ' -> .'•■>" - 

of bilingual education th^re was a shift toxrards^clgiowledging the velidity 

ti. ■ ^ • , . " fiti , ■ • 

of billnguallsm ^s a worthwhile educational goal and the importance of , , 

sttidents' LI in the learning of L2. For example, among the most" important ^ 

. . ' » : ; ' t' ■ ■ ' ■ ' ■ ' 

principles mentioned by two such students were: . , V 



"Literacy in LI and L2 (whic^ represents a cl^n^ f or me 
for I. now tend l:o think that the bilingual programs should 
be ones of maintenance, recognising individual :'dif£erences 
and parents' wishes)." ' 

"A Strong foundation in the home" language, ^especially in ; 
reading and writing, will make it easier for students to 
transfer skills to the second language leamirig/"i 
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Assessment Issues were emphasized by several students in the post- 
test which contrasts with the absence of such concerns in the pretest. ' For 

example : ^ ^ 

"Assessment of language proficiency in LI and L2 before 
attempting eny kind of L2 acquisition program (this would,, 
have to be done by not rqly^g on testjs that are already 
in existence; perhaps by combining a formal test with 
greater weight placed on teacher observation)." 

**Assessment procedures should be established to adequately 
determine the language acquisition needs of these students." 

' . ■ ■ • ■ . ' ' 

The following eloquent statement stjmmarizes some of the major 
principles that should guide program development for language minority 
students: - 



"Education for the minority language child must be implemented 
with consideration for the following principles: 

- A child caxmot learn in a lat^guage he or she does not 
ixnderstand. 

- Language learning depends upori the learner ' s active 
participation in the process. \ 

• New and difficult coxicepts can W more effectively learned ' 
in the person *s strongest language. New language can be 
more effectively learned upon concepts the person has 
already mastered. This involves cognitive demand from the 
concept or the language, but notyboth* 

• "Redundancy" facilitates language learning: when the meaning 
is apparent in the context. 

- children who feel good about the stuff (culture, language, 
experience) they bring to school, will be more easily, 
happily and successfully engaged in the learning process* "* 



Course Evaluation 

''J 



■L 



On the course evaluation form given 'to all students in the Berkeley 
Summer Program for Teachers, students were asked to rate the course and 



Instructora on four point scales (excellenibv- poor) and also to say what 
they liked best and leadt about the course^. Twenty ^tudents/were present 
to complete the form and their - ratings ver(B as follows: 

course evaluation: excellent 17 / 

good 3 

'c, instructors evaluation: excellent 19 

good 1 . 

Student comments also showed a high degree of satisfaction with 

the course. These are presented in Appendix 6. The only recurring reser- 

/ . . • • • . 

vation was that parts of the course were too theoretical and not practi- 
cally-*oriented enough; on the other hand several students commented Oh 
the appropriateness of the theoretical/practical bl^nd* As one student 

put it "nry interest in things cerebral has increased ten-fold", ' 

- ' - ' ■ . ' ■\ 

Concluding Comment ... 

Many of the teachers conmented that the opportunity for extended 
interactloa and sharing among themselves was extremely valuable* For us 
also» as IxSstructors, the interaction with such M committed and intellec-* 
tually vigdrotis group of people was one of the highlights o'f the course. 
Both of us learned .a great deal. 

We are aware that we have not provided the participants with any 
Instant solutions the problems pf language prof icleiicy assessment they 
face. To have even attempted to do so would have been futile, given the 
p^^esent state of ^the art. What we hope we have succeeded in doing is 
transmitting an orientation in which language proficlisncy assessment is 



vleved as an integral pap^ of the entire teaching process and In which 
ESL and bilingual edt^datlon are seett as two sides of the same coin rather 
than in opposition to each other* 
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, APPENDIX 1 (p. 13-18) 13. 

° EducaitTon 374E • ' • : 

SPEAKING OF ENGLISH; 
TEACHING THE LANGUAGE MINORITY STUDENT 

1981 Summer Session for Teachers 
University of California, Berkeley - - ' : ' ' 

Instructors: Jim Cummins, Ontario Institute for Studies In Education, 

Toronto * 

Li ly Wong FI 1 1 more. University of California, 
• Berke ley . 

Dlscusslpn Leader: Kip Anderson, University of Ca.l If orn I a, Berkeley 

Guest Lecturer: Susan U. Phi 1 1 Ips, University of Arizona, 
s TuCfSon (Week 4) . « . 

Off ice Hours: J im Cummins— Tuesdays, 1 :30 to 3:30, Room Tolman Hall 

Texts: Llndfofs, Judith WeMs: CHI LDREN'S LANGUAGE AND LEARNING, Engl ewood ' 
Cliffs, N.J. : Prent Ice-Hall, 1980. (Available at the ASUC Book- 
store on the "SS FT" shelf in the Textbook Depactment)^ 

Cohen, Andrew D. DESCRlBJNG BILINGUAL EDUCATION CLASSFpOMS: The 
Role of the Teacher In Evaluation. RossJyn VA: The National 
Clearinghouse for Bi lingua I Education (Available from Cummins). 

Goodman, Kenneth, Yetta Goodman 4 Barbara Fibres: READING IN THE 
BI LINGUAL CLASSROOM: Literacy and Bi 1 1 teracy. Rosslyn, VA: 
The National Clearinghouse for Bilingual Education. (Available 
from Jim Cummins) ' ' . . . " 

General Format: Classes wl 1 1 general ly commence with small group (10 or so 
per group) discussion/orientation sessions (for around. 30 ml nutes) . 
These are followed by a lecture on the day's topic by one of the '"struc- 
' tors br 'guest lecturer (ca. 75 minutes) and^ break (15 m nutes). /f+er 
the break, there will- be a class discussion of the topic (ca. 60 minutes), 
and- group work-sessions during which participants will work on their group 
oroiects. The project work wMI involve designing and producing an In- 
service package in the following three areas: (1°) Genera - approaches 
to the education of language minority students; (2) Principles and prac- 
tice of developing language ski Ms; C3) Language Vroficiency assessment. 

Project groups will be formed according to the target gi'^^®"'.®^® 'y?^/^* 
inservlce package being developed, namely K-3 (2 groups), 4-6, j . 

•adult. The final week of the course wl I I be devoted to class presenta- 
tions of these In-service training packages which will be 'aval lable for 
participants to copy for use in their own schools and districts. 

Readings on "each of the daily topics will generally follow the presenta- 
- tlon of the topic Ifi class. • 

Gra'dlhq for the course wl 1 1 be on an S/U basis only, with -grade assign- 
ment to be determined by overal I participation ih the course,^ completion 
of assignments, and quality of the final group'project work. ' 

' ■ " ■ JM ■ 



WEEK I (June 22-26) BACKGROUND AND APPROACHES: ISSUES IN THE TEACHING 
AND TESTING OF LANGUAGE SKILLS 

?4onddv (June 22) s * - 

A. Topic: Overview of the Course; Notions of language Proficiency 

B. Reading Assignment: LIndfors, Chapter I CAn.overvlevr of five dimensions 

pf language) * ' 

C* Asslgnttient: List (2 copies) what you believe are the most common mis- 
conceptions about language proficiency, 

Tuesday (June 23) : ^ \ ^ 

A. Topic: Cognitive and-^ Academic Aspects of Language Proficiency % 

B. Readings: LIn.djfdrs, Chapter* H (Communicative pompetence) 

Cummins, Jim: "The Role of Pr(mary Language -Development In 
Promoting, Ed ucatfoha I Success for Language Minority Students". . 
(Pag^s 1-21 only) ^ 

C. Assignment: Write out questlons/crltlclSms of Cummins* Pramework 

(Use carbonate make 2 copies, please) . 

Wednesday (June 24); 

A. Topic: Social and ^Pragmatic Aspects of Language Proficiency 

^ . . ♦ *^ , ' 

B^- -Readings: LIndfors, Chapter 12 (CJommunlcatlN^competence, teachers" 

and children) ' 

C. Assignment: Do eltheir #1 or*#7 of the exercises In LlndforSi^ pp 341-348,. 
or a. language sample analysis of your own choosing* 

Thursday (June-^-25): ' \ .\ ^ 

A. Topic: Oral Language Proficiency and Reading 

B, Readings: Wells i Raban: "Oral Language and the Development of Reading" 

LIndfors: RECOMMENDED FOR THOSE WHO HAVE HAD NO PRIOR .COUFSE- 
WORK IN LINGUISTICS OR IN CHILD LANGUAGE ACOUISITION) 
Chapters 2 (Native, Speaker Abilities), Chapter 5 (Perspec- 
tives on -Language Acquisition) , .and Chapter 6 -(l-anguage Acquis-; 
tlon: Developmental Sequence). 

C» Assignment: Ref lect on first week's content and write out any. questions, 
, , criticisms, etc.^^that you might t]ave. Please use a carbon to 

make 2 copies. 

Friday (June 26): Individual work on readings, assignments.. 



WEEK 2 (June 29-JuIy 5) HOW IS LANGUAGE ACQUIRED? 
fAondav (June 29) ; 

A. Topfc: First Language Acquisition 

B. Readings: Llndfors, Chapters 7 (Language acquisition; Active processing 

in an Interactive environment) and 8 (Language acquisition, teachers 
and chl Idren) 

(And for those who need the background. Chapters 5. & 6 of Llndfors 
•as weII\.-See Thursday, June 25 readings for details) 

Tuesday (June 50) ; v , 

' A» TopTc: How Are Second Languages Acquired? 

8. Reading^ LIndfors> Chapter 15 (DI fferent* languages, teachers and 

'children); Tucker & Gray paper (Cummins wt 1 1 have this "for- you) . 

C. Assignment: Identify from your own experience and Intuitions those 

aspects of second language acquisition that make It hard for 
some people^to learn languages after the- first. (Please make 
2 copies df this assignment by using your carbon paper) 

Wednesday CJuly I ) ; 

• A. * Topic: Issues In Teaching the Language Minority Student 
B. :Readlngsr Cummins (same paper assigned for Tuesday; June 23) , p* 2Pto*e(id»^ 



C. Assignment: Write-out (with carbon duplicate) one th^ret leal and/or 
empirical criticism of Cummins*^ argument. 



Thursday (July 2) : • 

A. Topic: 81 1 Ingual ism and 81 1 Ingua} Education 

8. Readings:' Cohen, Describing 81 Ungual Education Classrooms (see texts) 
- ' Flllmoref, "Thoughts on th'^ Non-Eng I ish Speaking Student" ' . 
(FI I Imore wl I Kglve you this paper In class) 

' C. Assignment: Wrltei-out fwlth carbon dup I tcate) some principles of' language 
, 'that ought to be taken Into account In language teaching and 
assessment. ^ o ' 

Friday (July 3) : Individual work on projects and assignments 



WEEK 3 (July 3- July 10) METHODS AND APPROACHES TO TEACHING LANGUAGE MINORITY 

STUDENTS . 

* ■ « , • . . ' 

Monday (July 6) ; 

A. -Topic: Teaching English to Non-Native Speakers: Exp I Id t Approaches 

B. Readings: Llndfors, Chapter 3 (Components of Language Structure) 

Terrell, "A Naturalistic Approach to Second Language Teaching*'' 
(Cummins Will give you this paper In class) 

Tuesday (July 7) :> ^ . 

A. Topic: Teaching English through Content Instruction (Indirect .Approaches) 

B. Readings: ^Llndfors, Chapter 9 (Language In Leanhlng) & Chapter 10 

(Language In Learning, Teachers a^d .Qh 1 1 dren) 

W-llsorli, "The Immersion effect" (CummJji& wJ 1 1 .£l ve this to you) 

C* Assignment: Do #7. on page 347 of Lindfors. 

Wednesday CJuly 8); ^ 

A. Topic: Text as Input for Language Learning 

B. Readings: Goodman, (Soodman^ i Flores (the whole- thing) ; Bel I , "The 

Emperpr's New Cloze" (Cummins wilt give you this); Haskell, 
"Putting Cloze Into the Classroom" (Cummins wl ( I give you i- 
"this too) . 

' C* ^Assignment: Write up one or more technique using text as Input for - 
language- learners that has worked well for you.. 

Thursday (JdTy 9) ; 

A. Topic: Idea Pot- 1 uck:^ Methods and Materials ' ^ 

B. Readings: A paper by Susan Phillips (TBA) 

C. Assignment: Please do the exercise In Cohen, pp. 29-34'. 
Friday (July 10) : Individual work on projects and assignments 
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WEEK 4Uulyl3-Julyl7) APPROACHES TO LANGUAGE PROFICIENCY ASSESSr^EfjJ 

Monday^ (July 1 5) ^ . ^ 

A* Topic:' Overview of Assessment Procedures 

. Readings: Section I of NIE Report on Testing and Assessment: "Valldl 

and Rel labi I Ity". (Cummins will provide) 

. *C^ Assignment: TBA 

Tuesday, (July 14); 

\ • ^ " ■ . 

A. Topic: Ethnographic Approaches to CJassroom Interaction 
(Guest Lecturer: Susan U. Phillips) 

Bv Reading: TBA 

C. Assignment: TBA ' ^ . 

Wednesday. (July 15) : ^ * 

A* Topic: Ethnographic Approaches to Language Proficiency Assessment 
(Guest Lecturer: Susan U. Phi f lips) 

B^ Reading: TBA 

C. Assignment: TBA 

i Thur&day; (July' 16) : 

A. Topic: Naturalistic Approaches to Language Proficiency Assessment 

B. Readings! Fi 1 1 more paper let* on language proficiency assessment- 
Friday, (JulV (7) : Individual work. on projects and assignments " 



\ 



104 



MUMi^itfMiiii^liliMiittMllirilliiltt 



WEEK 5 (July 20 - July 24) APPLICATION & PROJECT PRESENTATIONS 
Monday, (July 20) : 

Topic: Group I, K-3 Presentation 

Tuesday, (July 21); 

Tojpic: Group' 2, K-3 Presentation 

Wednesday, (July 22); - 

Topic; Grpup 3, 4-6 Presentation . . 

Thursday, (Jiily 23): . ^ 

Topic: Group 4; 7-12 & Adult Presentation 

Friday, (July 24); 

Topfc: " Synthesis and Course Evaluation 

♦ * 

■ . ■.. _ ■ . ■ ■ \ 



APPENDIX 2 (p. 19 - 20) V 19. 

■ ' ' '* . . ■ 

Education 374E. - 

Questlonnatre „ June 22, 1981 



Name . S ummer phone 

Home Address (permanent) ■ . 



Present positron and/or function^ ^ 

School/Dtstrtct; 



iSrade levels you are prfmarMy Involved with: K-3 4-6 ' 7 -1 2 C ol leg e 

Any prior courses related to this one? (e*g», ESL, L2 Acquisition, Linguistics, 
Bilingual Education, etc,) * — 
non e 

1-2 • , ; 

3+ . 

Check whether you have figent (F), IntennedIa;Jje (I) qr negligible (N) knowledge 
of the following languages: . . 

French F_^I__N___ . F I N v 

Spanish P^^JL^ ' F . I N 

German F_^l_N__ - 

Vihaf do yoU' hope to get out of this course? . ._ ^ 



Have you any research or practical experience In the use^ of language proficiency 
tests? If so, which one(s.)? 

Is there anything you would like us to know about you? ^ 



\ 
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Questionnaire, page 2 



Education 374E 



What !s your present understanding of the term "language proficiency"?, 
Try to define the term as you understand It, specifying Its frost central 
attributes: ^ 



Based on your own experience and/or intuitions, what are themost Important 
principles which you feel ought to guide educational practice and policy 
for language minority CLES/NES) students?^ . 
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^t^^ APPENDIX 3 (p. 21) • 

< . ' ■ . , ■ . ■ ' . 21. 

23 Jtme *l98i ' 



Most of what you have stated makes g-ense to me* In fac-13,. it 
confirms in my mind that, what passes for bilihguai education in-. - ;* 
moist areas (and. certainly 'Oakland )is based on. faulty theories of ' , 
how second I'anguage acquirers' can- best" achieve; English prof iciency/-' 
in all of its forms. ^ \, ' * - ; 

The terjns tl>at you use are new to me and well explained, -ayid in ' 
many; instances are confirete evidence of soigething I fve' suspecteti 
for a long time. Teachers whp are successful. Xri teaching language 
prodra.ciency to native speakers as well as hon-risl^tive speakers realize, 
irttuitively perhaps, that linguistic and communicatiire^ in all its. . 
forms) competence go hand in hand and all langua'ge- is inter-related 
and not strictly compartmentalized. " ' 

. , I, ■ ' - ^ ^ ^ ' ■. ■ .- - . ■ 

-/■■■■. ■ " -. . ■ •-, - ■ . . 

1. What, if any kinds of exit criteria should be used 'in a V 
quality bilingual [^i'bgram? - ' ' . ' . - : ^ 

2. Are yoii^jmasintaining that ail second language acquisition " C 
student? should "be in a full bilingual program? »' 

, 3* What -role do ypju see SSii performing in a bilingital students V " 
role of attaining language proficiency in English? " 
4. Are there any circumstances you can see an LI studen* not 
being 'in a bilingual; program 'but entirelyvin an ESL Program? 
. 11" sov %hat are the ' conditions? • ' 

5- What Ijypes of testing devices can or should psychologists. 

use in evaluating an LI child to determine if lack of academic " 
' progress is due to lack of English proficiency- or a genuine - 
learning disability? Should such students even be tested ' " 
..#ith such culturally biased tes,ts? . ' ' 

6. How did the districts -you noted as having ^ua'lity bilingual 
programs get started given' the political and monetary hurdles? 

7. Would having to. serve only one particular bilingual group - 
make the impleraeri.taitiion- of a quality bilingual program easier? " 

8. -In the quality prpgrams youmote^, were the bilingual staff- 
tested for their competency Icn the primary language and English? 

9. Why do youthir^ the notion of "linguistic mis-match" figures- 
. so greatly in explaining the lack of academic- progress of> 

failure of -LI' students in bilingual programs in the U.S? . ' 
. Do you think It- has to do with an ethnodentric. vjLew or socio- ' 
economic factors? Or isft even more complicated than that? ' 
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•APPENDIX 5 (p.- 23 - 28) 



23. 



/ M. Yaraagishl 

Education 3^^B 
" . ■ Inservice Workshop ^ 

' Grades 9-12 

' ASSESSaSNT OP IHE E.S.L, STUDENT AT THE 
SECONDARY LEVEL 

OUTLINE 

I, General Problems of Assegsment: 

*• ■ ' . ' . . ' ' - . . ' ■ " 

A. Many schools* don't even'have and E3L progxam. ' 
;^B.-. Befeardless of' ^he Isvel, ' students are "dumped" into content 
" area classes with native speaJters. 

C, Many come in without any previous testing . J . 

D;' Those students who do. come in with test, scores are still not _ • 
adeouately assessed due to ihe lack of valid feests for E3L students. 
U Proliems of, criterion validity and content validity exist, 
(e.g. The Bilingual Sytax Measure tests for synta:e and 

grammar usage, hut Is that a valid measure of language 

proficiency??) ' ^ j * + 

2» The state of Calif .hasn't; approved or recommended any test . 
aa valid for the "secondary level. ' 

II . Sujggestiong for Assessment i 

A View' assessment (Jf language skills as having a; broad base. Nojine 

or SSes^ g^i to accurately diagnose language^ proficiency ^ -^ 
or predicTfor academic success. ^(eVg. correct oral reading -phQnetic 
decoding-- does not indicate language proficsiency.) 

3^ personal histoiry of the ESL student. It can Jffer valuable 
information for your teaching. (See (juesUonaire, Pig. V 

C. Pay attention to the social skills of 3rour student, both in and out 

of class, (e.g. does he initiate sjuestions? attempt to use the language? 
interact with native speakers?- ask for help? etc.) 

D. Be sensiUve to students' culture shock experience( especially for ' y ' ' 
-efmrees from Central America and Southeast Asia) —it may be , harder ' 

to assess their real capabilities and language skills at the beginning 
of your class. View assesment as an ongoing process.. 

E. Don't expect a student's fluency in oral production/comprehension 
to match his writing skills. Oral fluency normally com 3 to,^^ _ 
years soorfer than written language fluency in second language acaul- 

^ sittoni " ■ . 

V. Use an possible resources people-counselors, ESL teachers, student 
' / Beers, county ^'sources (some offer translation services), parents 
(if translators are available), the students other teachers. 
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tl. Sug,?esiiona for Assesaaent (cont#) 



G« .Recognize th it proficiency in English can enconpasa ptpficiency in a.;, 
vide retnge cf language skills* (see unit analysis by l«)f» FULmbre on 
oral language as an exa3iple)r Consequently, it'S iTsiportant for you to 
determine what partlcx;QLar language skills are necessary for participation/ 
success in your class « Your assessaent should focus aainly on the skill's 
; you choose. — 

1» Give yoor students comprehension questions or activities that focus 
* on the particular skilis you choose* , * ^ " , 

2^ Keep an inf ozroal chart on hoK ^f ten the student demonstxates the skipLls 
you* decide ahove» (see the example assessment chart. Fig* 2) 

H* Focuse on ho>f well the child can communicate ♦ Other areas such as spell- 
ing or grammar should not he over?-emphasi2ed ai 'this point over their 
comprehension skiUs. 



- GRADING THB E3L StUDSKT: PROBLEMS & 3UGGSSTI0NS 

Ha jor questions Do you grade the student hy the relative competence his 

\ ^ English skills as compared to. the native speakers or ; 
\ you grade by the amount of effort and/qr progress^that* 

\ has been accomplished in learning the second language????? 

Problems i !• Comparing Lg students to native speakers seems unfiir^ especially 
. T . if the Lg student is bright and has made excellent progress • 

\ Moreover^ how then can you use grades as a;positive reinforceaehh* 



2« Howeverjr to maintain school district standards means these stu« 
dents must pass some kind of criteria thai demonstrates their 
f ' \ ability to function in the next level -of difficitLty. Pasring 

I h ti&em may be actually a disservicei. 

Response: (you^re not going to like this..*) There's probably no way you'll 
V . be cdmpleteiy satisfied with the grade you gi"i^ to the ESIi stmjenjj^ j 

L Whatever happens, don't be overcome; with the "Guilts". Do/hoveveri 

^ i^e a point to sit down with -^e student and discuss his grade with 
■ ^ - breaking down his glrade in the class ii\ to specific areas so 

|_ ti^t he can get positive feedback on what hes^^^^S ^S^'^^ and so 

tb^t you can encourage him to continue his r^te of prqgress. 
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Figure 1 - Questlonalxe for ESL Asessment 



1, Name* First- • Last (Family name)- • 

2*« Address/phone hvuaber 

3. Class schedule (name of class, teachter, period) ; "* • 

Native country- City- • . .. 

Date of arrival 

What' language do you speak at hoiae? ^ . , 

What is your father's job? What is your aethers job? 

How long di^i^you go to school in your native .country? What grade did you 
finish? o . . 

Did you ever study English? If yes, for how long? 

Did you live anywhere else in the United States before living in Union City ? 
How many people speak English in your home? Who are they? 



■ 6. 
7- 
8. 

10. 



Do you have friends that speak English? 

The following kinds of informaUon would also be useful to find out but may be 
inappropriate for a q^uestionsire. 



\ 
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1. 

2. 

«. 

it. 

5. 
6. 



Age 

Whether or -not they live with their parents ^ 
Kymber of people in their faaily here in the U.S. (living with them; 
Whether they like living in the US. . ^\ 

Whether they were forced to leave their country (i.e. refugee?; 
Personal aspirations for higher education or jobs 

w m i ninnmiii t itumnnn' inn Ht*<HHHif** 



0 

Figure 2 - Example Assessment 'Cliart for Language skills 



Subject- Social Sciencesi History class 
Unit ^ American Revo lution^ 

No attempts 



1 • Answers Questions 

about Tei^ngs * 
2. -makes inferences ^ 
3# gives opinions^ 

restates major events 
5* tmderstands vocab* 
6. follows written 

directions 
7* follows oral 

directiond 
8# A^s for help 



Attempts 



'Attempts & 
succeeds 
sometines 



Usually 
succeeds 
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A Partial List of .Oral and Uxltten Language Skills 



O ral Language Skills CGoHiprehetislon and produQt:uQnl 

Is the Student able to«~ 

explain? , " 

format situations? 
describe?' . 

narrate? • . / 

give directions?^ » * 

Integrate new infromation with old irifomatlon? 

give examples? 

define? . " 

summarlzeT 
call attention to important details? 

designate 0 main' points? 

give opinions? ^ 
/ask for more Information? 

follow /jdirectLons? 

ask for attention/help? 

understand rules of behavior in class? 
^ understand procedures of class activities? 
'^ask for claxificaticn? 



Written "Language Skills • 

Skills involving good structures 

correct grai&mar usage 
^ntax 

sentence completeness 
approptdate-^'orl choice 
sentence variety 
Coherence 

Other skills: " 
organization of ideas 
coordination of ideas 
subbordinatlon of ideas 
uses of synomyms 
logic 

going from general to specific 
legibility 
. creatiiity 
imagination 

' reading comprehension skills 
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APPENDIX 6 (p. 29 - 33) 
STUDENT EVALUATION OF THE 
1981 SUMMER PROGRAM FOR TEACHERS 



1. Number and title your course: 



2. 



3. 



How would you evaluate this course? (Check on6) 
Excellent Good ; Fair 



How would you evaluate youar instructorCs) ? 
Excellent _J Good . Fair 



4. What did you like best about this course? 



Poor 



Poor 



29, 



S. What did you like least? 




6 . Other conme^its : 



7. What kind of course Cs) do you think would interest you or your' fellow 
teachers next sununer? /vujt iOAAow 



r" 



LIKED BEST 



Appendix 6 
STDDENT COMMENTS OH THR rmipgp 



J^IKED LEAST 



1. I had opinion^ about ESL and bi- 
lingual education but didn't have 
much Idea of what the authorities 

^ thought or what the' research Indl- 
cated until I toolp this coursd. 
It definitely deepened my under- 
standing of what I was trying to 
do as an ESL teacher. I enjoyed 
the format and the contrast In 
Instructors. 

2. the -exchange of Ideas, activities 
and experiences between the mem- 
bers of the class, all of whom 
share a common Interest In this 
field. 



Group presentations, sharing of 
Ideas with fellow educators. 



Basic structure of course. The 
practical aspects of the grade- 
level methods of Instruction; 
Some are applicable even at the 
senior high level. 



I most enjoyed the exchange of 
Ideas from people In various 
degrees of teaching ESL. The 
research and theory of others 
enlightened me and helped me 

formulate new Ideas of teaching 

ESL. 

o . , 

ERIC 



Overly long lectures, dealing with 
Owhat I considered .t^>' be) abstract 
theory, that would not be applicable 
to my dally classroom teaching. 



Lectures t6o long sometimes. Mould 
have liked less theory, more prac-. 
tlcal applications, ! 

Some of theory lecturesi could have 
been condensed. The Phillips lec- 
especlally could have been condensed 
to a 3 hour lecture. (?) 



I'm afraid too much theory In hour 
can cause me to tune 
put . . . even If I realize that I need 
the theory to function Intelligently. 
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OTHER COMMENTS AND , 
' [.NEXT SUMMER CQURSg. 

* More fielp in Implementing Ideas that' 
I learned,- . 



Cummins and Fillmore both ImpxesB me 
^i*"? their knowledge of current research, * 
their abilities to communicate, their 
Interactions with the class members, and • i 
their enthusiasm for the subject and the 
class. Itself 

* More practically oriented course. 

* More practice, less theory. 



I enjoyed the Informality of the class, 
and have gained aOme vjery" valuable Infor- 
mation. . . s. 

* An Intensive course on tried and uaefui" 
techniques to use In teaching ESL students 
at the senior high level exclusively. - 
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\LIKED BEST 



LIKED LEAST 



6, Format of presentations, the link- 
ing of ctkrent theoretical research 
and 8ugig;iBs1:lon"s for practical 

me thodo logy\ 

■ ■ ; \ • . I 

7. I found out ab^t assessment tech- 
niques to use In the classroom. 
Learned some new techniques for 

promoting dral and written skills. 
Realized that there are people In 
the field who are Interested In 
bilingual education as an educa- 
tional tool, not as a political 
device. . ' I 

8. The entire course was belief Iclal I 
tome. I found all the materials 
and Informative presentations ex- I 
cellent. I'm glad I took the 
course. j 



Reading the paper by Mr. (himmlns— 
It was too cognltlvely demanding. 



There was an 'extensive amount, of 
Informational material presented 
In so little time. I feel It would 
have been better If the class-was 
an eight week course. ^ 



9. Totally new Insights Into second 
language acquisition. Ideas on 
evaluation/assessment of LEP 
students, group projects. 



The detailed and Intricate fac- 
tors of language proficiency, 
clarification of elements 
Involved in L2 acquisition and 
the brief mlscue analysis. 



ERIC 
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OTHER COMMENTS ANDN 
NEXT SUMMER COURSE 
"~ PpFEtENCE 



I found Susan Philiips lectures on 
mlcroethnography to be of Value in 
assessing languagi^ proficiency. 



Presentation" l:- : t* :- „ :.,;..;,..; ... -, 
very informative. They- g^ve ma an 
inslghC into methods and materials 
used at other levels. 

.* This course is well worth the time. 
Ariy teacher who is' concerned for their 
pupils' language progress should consi- 
der taking 1%. 



I was under the impression that student 
assessment was going to be covered, t 
assume this was overlooked because it 
Is so difficult to assess a students* 
potentials. ^ - 

* Adult ESL methods. 



Cummins and Fillmore are a good blend as 
Instructors. They complement each other: 
beautifully. 

* Anything Involving ESL/Bilingual. 
Would definitely recommend this course 
for my entire faculty. 

This course should have more exposures 
,ln school districts impactad by language 
minority students. 

^ Mlscue analysis for use with evaluation 
of language minority students. 

■ ■■ , ■ ■ X /d id ■ W 



LIKED BEST 

The opportunity to work wlfh other 
teachers with similar reapbnslblU- 
ties and problems in their work. 
Xhe presentation of the most recent 

J^^f conclusions rele- 

vant to the Issues at hand. 



LIKED LEAST 

It was difficult for me to keep up 
Sntsf and written assign- 



Format was vaieie.d. gtoup work 
very productive. 



was 



Walng other teachers for resource. 

ia««;:r^ acquisition articles 

passed out In class. Guest lectur- 
er. Jay Kleckner. 



Need another break, not used to 
lectures and sitting. 

Text; If the lecture" went over Ik 
hours, the room (It was freezing) 



tost of the topics discussed In 
he course are not new to me: 
owever 1 like the Idea of sharing 
nfo^iatlon among my classmates 
nd finding out what other' ESL- " 
lllngual teachers are doing to 

each the language minority * 
tudents. 



OTHER COMMENTS AND 
NEXT SUMMER COURSE 
..PREFERENCE" 



* More of same. 



went. Blllngual/multl-culturai; 

really enjoyed iLllv^s 
her constant effoH ta.fceep the cSt" 
on a practical focus, i also app«! 
elate her ability; to Integrate dlf?er^ 
ent points of View or methodologies ^r 

Course Is too short. 



le format in that it gave a good ' 
^erylew of the different theories, 
d the reading. * 
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Thls^ls the best cp^irse I haVe taken In 

o* r would like continuation of this 
cours^. going more into detail In the; 



